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1.  Introduction 

This  lepoit  (tescribes  the  woric  accoiiq)Ushed  under  the  AFOSR  grant  F49620-92-J-0228P00002.  The 
research  being  accoiiq>lished  under  this  grant  is  the  investigation  of  the  usefulness  of  additional  information  for 
reducing  noise  in  images.  The  use  of  information  in  addition  to  measured  Fourier  data  to  improve  the  resolution  in 
reconstructed  signals  has  received  a  considerable  amount  of  attention  over  the  last  five  decades^'^.  The  kinds  of 
additional  information  typically  used  can  be  categorized  in  two  ways;  flexible  constraints  and  rigid  constraints. 
Flexible  constraints  are  usually  used  to  reject  solutions  to  the  deconvolution  problem  (i.e.,  regularize  the 
deconvolution  problem^)  which  are  unacceptable  because  they  include  nonnegligible  high  frequency  structure 
which  results  ^m  noise  rather  than  from  signal.  Because  it  is  impossible  to  accurately  reconstruct  a  space-limited 
signal  which  is  noi^  from  any  finite  portion  of  its  Fourier  spectrum  due  to  the  infinite  extent  of  its  Fourier 
transform,  these  constraints  are  flexible  since  any  reconstruction  will  be  inaccurate  (either  from  noise  in  the 
Fourier  data  or  firom  sidelobes  due  to  the  truncation  of  the  signal's  Fourier  spectrum).  This  flexibility  allows  one  to 
trade  off  the  structure  and  amplitude  of  noise  in  the  reconstructed  signal  with  the  recovered  resolution  in  the 
signal.  Rigid  constraints,  on  the  other  hand,  reflect  information  about  the  signal  which  any  reconstruction  is 
required  to  possess.  Thus,  rigid  constraints  define  an  accurately  known  subset  of  the  solution  ^ce  that 
reconstructed  signals  must  reside  in,  and  flexible  constraints  d^ne  unacceptable  regions  with  fuzzy  boundaries 
within  this  subset. 

Usually,  flexible  constraints  are  some  form  of  smot^hness  constraint  inq)osed  on  the  reconstructed  signal. 
These  types  of  constraints  are  included  in  a  cost  function  definition  weighted  tty  a  Lagrange  multiplier  which  is 
chosen  to  provide  an  qitimum  tradeoff  between  noise  and  resolution  in  the  reconstnicted  signal  relative  to  a  chosen 
definition  of  <q>timality.  It  is  important  to  note  that  in:q>roving  resolution  in  this  context  means  decreasing  the 
point  q>read  fiinction  width,  not  increasing  the  bandwidth  of  accurately  known  Fourier  data.  Using  flexible 
constraints  to  decrease  the  poim  spread  function  width  does,  in  fact,  increase  the  bandwidth  of  the  Fourier  data,  but 
without  including  rigid  constraints  (either  explicitly  or  implicitly),  the  new  Fourier  data  will  be  virtually  all  noise 
and  wUl  result  in  increased  noise  levels  in  the  reconstruct^  signal.  Enq>irical  evidence  suggests  that  point  spread 
function  widths  can  be  decreased  by  a  frictor  of  two  or  more  as  conq)ared  to  the  point  ^tead  function  widths 
correqxmding  to  inverse  Fourier  transforming  truncated  Fourier  data  without  imposing  regularization  constraints. 
This  useful  decrease  in  point  spread  fiinction  width  can  be  attributed  to  the  human  visual  tystem’s  ability  to  rqject 
the  random  noise  which  accompanies  decreased  point  spread  function  widths.  The  usefulness  of  flexible 
constraints  to  inqirove  image  quality  was  not  pursued  imder  this  grant 

The  other  category  of  additional  information,  rigid  constraints,  includes  information  about  the  signal  such 
as  its  region  of  siqiport  and  the  foct  that  the  signal  is  positive^A  if  qipropriate.  Many  results  can  be  found  in  the 
literature  which  show  resolution  inqirovements  of  a  ^or  of  two  or  more  when  siq^rt  and  positivity  (or, 
equivalently,  positivity)  constraints  are  aj^lied.  However,  these  improvements  are  usually  d^ermined  Ity  reduced 
point  qnead  fiinction  widths  and  not  upon  the  accurate  extenaon  (ff  measured  Fourier  data  bQ^ond  the  maximum 
measured  bandwidth.  Thus,  these  improvements  more  accurately  reflect  the  tradec^  between  noise  and  robustness 
using  flexible  constraints  rather  than  actual  Fourier  data  extrapolation.  It  has  been  shown^  that  accurate 
superresolution  as  measured  by  the  accurate  extension  of  measured  Fourier  data  is  negligible  for  objects  which  are 
at  all  resolved.  As  a  result,  superresolution  is  not  part  of  the  research  focus  of  this  project. 

AnotlKr  way  rigid  constraints  can  be  used  to  inqirove  image  quality  is  Ity  using  them  in  order  to  reduce 
the  noise  in  the  measured  Fourier  data  which  results  in  noise  reduction  inside  the  image  support  in  the  image 
domain.  This  is  a  different  issue  than  the  one  dealt  with  Ity  using  flexible  constraints.  With  flexible  constraints, 
the  data  in  the  Fourier  domain  is  filtered  to  reduce  noise  in  the  image  domain,  but  the  signal-to-noise  ratio  (SNR) 
of  the  Fourier  data  remains  unchanged  at  every  frequency.  As  a  result,  less  noise  ajqiears  in  the  image  domain,  but 
the  resolution  in  the  image  domain  decreases  as  a  r^t,  which  is  the  previously  mentioned  tradeoff  between 
resolution  and  noise.  With  rigid  constraints,  on  the  other  hand,  it  is  possible  to  increase  the  SNR  of  both  the 
Fourier  domain  data  and  the  image  domain  data  with  no  decrease  in  resolution  in  the  image.  It  is  this  aspect  of 
additional  information  that  is  being  pursued  under  this  grant 

The  primary  focus  of  this  research  effort  is  the  derivation  of  theoretical  expressions  which  predict  the 
amount  of  noise  reduction  in  the  image  domain  as  a  result  of  using  prior  knowledge  in  addition  to  the  measured 
data.  The  theoretical  emphasis  was  chosen  because  most  of  the  theoretical  woric  already  accomplished  with  regard 
to  addititmal  information  is  in  suiqwrt  either  of  achieving  superresolution  or  to  determine  convergence  of 
al^mthms.  However,  virtually  no  woric  has  been  accomplish  in  the  area  of  theoretical  predictions  of  SNR 
changes  in  the  image  domain  or  Fourier  domain  as  a  res^t  of  additional  information.  Nor  has  any  woih,  to  the 
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author’s  knowledge,  been  published  which  has  identified  the  essential  mechanisms  by  which  prior  knowledge 
causes  noise  reduction  in  images. 

Because  the  work  is  theoretical,  the  decision  of  how  to  model  the  noise  corrupting  the  image  is  critical. 
The  more  general  the  noise  model,  the  more  types  of  data  to  which  the  theory  aiq>lies,  but  the  greater  difficulty  in 
obtaining  useful  insight  from  the  theory.  The  simpler  the  noise  model  is  assumed  to  be,  the  more  easily  the  theory 
is  interpreted.  The  compromise  chosen  in  this  research  is  to  model  the  noise  in  the  image  domain  at  each  location 
X  as  delta-correlated  noise  with  the  possible  exception  of  non-zero  correlation  with  the  noise  at  location  -x.  This 
results  in  Fourier  domain  noise  which  is  wide-sense  stationary  except  close  to  dc.  This  noise  model  accurately 
models  both  charge-ccnqrled  device  (CCD)  read  noise  aiul  Poisson  noise,  which  are  two  widely  encountered  noises 
in  imagery,  especially  fiom  images  of  space  objects  collected  ground-based  telescopes.  This  noise  model  does 
exclude  gay  noise  in  images  which  have  had  any  sort  of  blurring  function  deconvolved  out  of  them.  The  act  of 
deconvolution  can  be  viewed  as  a  special  type  of  convolution,  and  convolution  results  in  correlated  image  domain 
noise.  Unfortunately,  the  theory  is  quite  complicated  for  correlated  noise,  and  that  can  hinder  the  usefulness  of  the 
theory  as  a  guide  for  how  to  optimally  include  additional  information.  As  a  result,  the  ^roach  taken  in  this 
research  effort  is  to  use  the  re^ts  fiom  uncorrelated  noise  models  to  guide  the  results  for  correlated  noise. 
Quantitative  results  are  obtained  for  Fourier-domain  wide-sense  stationary  noise,  and  qualitative  results  are 
obtained  for  more  general  noise  statistics. 

The  rest  of  this  report  summarizes  the  work  acconqrlished  under  this  grant.  Section  2  contains  the  work 
achieved  in  regards  to  using  support  as  a  constraint,  section  3  contains  the  work  achieved  with  positivity  as  a 
constraint,  section  4  contains  the  woric  accortqrlished  using  prior  high-quality  image  data  as  a  constraint,  section  5 
discusses  the  triplication  of  the  theory  to  images  collected  on  telescopes  using  adaptive  (pities  to  remove 
atmoqiheric  blurring,  section  6  summarizes  the  publications  resulting  fiom  this  research,  and  section  7  contains 
conclqsions.  .^qiendices  A-E  contain  copies  of  papers  eitter  to  be  published  as  pert  of  the  woric  under  this  grant 
or  to  be  submit^  The  ptqier  in  afriendix  A  is  the  result  of  work  acconqilished  under  an  AFOSR  lab  task  at  the 
Phillips  Laboratory  just  prior  to  the  work  accomplished  under  this  grant.  The  research  into  using  additional 
information  for  error  reduction  started  with  this  woilc  and  thus  it  is  included  for  completeness. 

2.  Smmort  as  a  constraint 

The  research  on  using  support  as  a  constraint  is  complete.  Appendix  B  contains  a  paper  that  ajqieared  in 
the  Jaruiary  1994  issue  of  the  Journal  of  the  Optical  Socie^  A  which  contains  the  results  fiom  the  work.  The 
results  will  be  summarized  in  this  sectiort 

The  noise  model  used  for  these  results  is  generalized  delta-correlated  noise  as  described  in  section  1,  with 
one  sinqilification.  In  the  Fourier  domain,  the  Fourier  transform  of  the  noise  n(x),  (Nf,N|),  has  the  following 
properties; 


(Nr(U,)Nr(U2))  =  R,(0,-U2)-fR,(u,+U2) 
{Ni(U,)Ni(U2))  =  Ri(U,-U2)-Ri(Ui-fU2) 
(Ni(U,)N,(U2))  =  Ri,(U,-U2)  +  Ri,(U,+U2) 


For  simplicity  and  clarity,  the  terms  which  are  a  fimetion  of  0^+02  are  neglected  because  their  contribution  is 
primarily  around  dc.  This  results  in  noise  in  the  Fourier  domain  which  is  wide-sense  stationary.  In  addition,  the 
cross-correlation  between  the  real  and  the  imaginary  terms  are  also  neglected  purely  for  simplicity  and  clarity. 

Now  assume  that  the  variance  of  the  real  part  of  the  measured  Fourier  data  is  less  ti^  or  equal  to  tte 
variance  of  the  imaginaiy  part.  Because  the  results  are  completely  symmetric  for  the  case  where  the  variance  of  the 
imaginary  is  less  than  or  equal  to  the  variance  of  the  real  part,  no  loss  of  generality  occurs.  In  the  paper, 
theoretical  results  are  derived  which  predia  the  change  in  image  domain  noise  variances  when  the  following 
algorithm  is  enqilqyed:  (1)  inverse  Fourier  transform  the  measured  Fourier  data,  (2)  apply  suiqiort  constraints,  (3) 
Fourier  transform,  (4)  replace  the  real  part  of  the  support-constrained  Fourier  estimate  with  the  measured  data,  but 
keq>  the  imaginary  components  unchanged,  (5)  go  b^k  to  step  1  and  repeat  until  the  noise  is  minimized  inside  the 
support  constraint.  The  primary  reason  this  algorithm  was  chceen  is  that  it  allows  an  iteration  iteration  analysis 
of  the  variances  in  the  siqiport-constrained  image  and  Fourier  data.  A  summary  of  the  theoretical  results, 
confirmed  1^  computer  simulation,  is  as  follows; 
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(a)  As  long  as  the  real  part  of  the  measured  Fourier  data  is  not  completely  noise-free,  minimum  noise  is 
achieved  inside  the  support  constraint  in  the  image  domain  after  only  a  finite  number  of  iterations.  Beyond  this, 
the  noise  increases. 

(b)  The  noise  in  the  symmetric  part  of  the  su{^it  constraint  is  unaffected  by  the  application  of  support 
constraints.  Only  the  noise  in  the  asymmetric  part  is  ^ected.  Thus  asymmetric  support  constraints  are  the  only 
type  which  can  achieve  noise  reduction  inside  the  siq)port  constraint. 

(c)  ff  Rf=Rj,  no  noise  reduction  is  possible  inside  the  support  constraint.  This  rase  is  particularly 
inqmrtant  because  this  is  true  for  both  CCD  read  noise  and  Poisson  noise. 

(d)  Rf  must  be  less  than  60%  of  Rj  for  noise  rediKrtion  to  be  possible  inside  the  support  constraint.  This 
result  is  indq)aident  of  the  noise-ftee  object. 

The  proposed  algorithm  was  compared  with  a  standard  convex  projections  algorithm,  where  the  Fourier  domain 
convex  set  was  defined  as  the  region  in  the  Fourier  domain  whore  the  siq>port-constrained  Fourier  data  st^ed 
within  ±lo  of  the  measured  data.  The  results  were  as  follows: 

(a)  The  convex  projections  algorithm  alwttys  resulted  in  increased  noise  inside  the  symmetric  part  of  the 
siqiport  constraint,  while  the  prt^tosed  algorithm  did  not  affect  the  noise  in  this  region. 

(b)  In  the  atymmetric  part  of  the  support,  the  proposed  algorithm  had  comparable  or  better  performance 
than  the  convex  projections  algorithm  if  both  algorithms  were  stopped  at  the  point  of  minimum  noise. 

(c)  The  point  of  minimum  noise  when  using  the  convex  projections  algorithm  was  at  the  same  point  as 
for  the  pnqposed  algorithm.  Beyond  this,  the  noise  inside  tte  siq^rt  constraint  increased.  It  appears  that  there  is 
a  fundamental  property  being  demonstrated  here.  The  convex  projections  ^roach  assumes  that  the  correct 
convex  sets  can  be  generated.  Then  the  best  image  reconstriKrtion  must  reside  in  the  intersection  of  these  convex 
sets.  However,  it  tq^tears  that  with  noisy  data  the  convex  set  generated  to  constrain  the  region  that  the  siqqtort- 
constrained  Fourier  data  can  reside  in  does  not  intersect  the  convex  set  generated  Ity  the  siqqwrt  constraint,  in 
general.  It  should  be  possible  to  generate  a  convex  set  firom  the  measured  Fourier  data  large  enough  to  have  an 
intersection  with  the  siqiport  constraint  convex  set,  but  there  will  be  little  or  no  image  domain  noise  in^rovement 
in  this  case  because  the  Fourier  domain  convex  set  is  so  large.  In  trending  more  time  looking  into  the  literature,  it 
turns  out  that  the  vast  majority  of  convex  projection  papers  assume  noise-fiee  data,  or  at  least  that  the  convex  sets 
can  be  generated  accurately.  It  is  eqtecially  misleading  because  the  convex  projections  algorithm  does  converge 
when  noityr  data  is  used  to  generate  the  Fourier  domain  convex  set  -  just  not  to  the  point  of  minimum  noise!  To 
test  things,  I  reran  the  convex  projections  algorithm  with  the  Fourier  domain  convex  set  generated  with  both  the 
correct  mean  and  variance.  I  started  the  algorithm  with  the  measured  Fourier  data,  and  then  the  convergeitce  point 
of  the  algorithm  was  the  point  of  minimum  noise.  Thus  it  ai^)ears  that  algorithm  performance  is  not  a  problem, 
but  rather  noity  data  inherently  makes  it  inqxtssible  to  generate  consistent  Fourier  domain  convex  sets  which, 
when  of  reasonable  size,  intersect  the  convex  set  generated  firom  the  support  constraint. 

3.  Positivity  as  a  constraint 

The  theoretical  results  which  predict  the  usefulness  of  positivity  as  a  constraint  have  been  conq}leted,  and 
verification  of  these  results  via  computer  simulation  has  been  acconq)lished.  The  same  noise  model  as  in  Section  2 
was  used,  with  some  modification  as  discussed  below.  The  theoreti(»l  results  assume  that  the  algorithm  of  section 
2  is  used,  where  the  siqiport  constraint  is  replaced  by  the  positivity  constraint  (that  is,  all  negative  values  in  the 
image  are  zeroed  out  at  each  iteration).  A  list  of  the  results  obtained  is  as  follows: 

(a)  Positivity  behaves  as  a  signal-dependent  siq^rt  constraint.  Because  of  this,  more  assumptions  are 
needed  in  regard  to  tte  noise  properties  in  order  for  reasonably  uncomplicated  theoretical  results  to  be  derived. 
Thus,  the  noise  is  as  discussed  in  the  introduction  with  the  addition  of  the  requirement  that  the  noise  n(x)  be 
gmissian  for  every  x.  This  allows  the  joint  probability  density  functions  to  be  generated  that  are  necessary  to 
theoretically  predict  the  behavior  of  the  noise  from  iteration  to  iteration. 

(b)  As  fin  siqtport,  noise  reduction  in  the  image  domain  is  only  possible  in  the  asymmetric  part  of  the 
positivity-induced  siqqxnt  constraint  No  noise  reduction  occurs  in  the  symmetric  part  of  the  positivity-induced 
siq^port  oonstiaint 


(c)  The  main  difference  between  the  results  using  positivity  versus  using  support  as  a  constraint  is  that 
the  positivity-induced  support  constraint  changes  size  on  each  iteration,  in  general. 

(d)  Although  tte  results  are  not  completely  symn^tric,  similar  noise  reduction  is  possible  for  either  the 
teal  part  of  the  measured  Fourier  data  more  noisy  t^  the  imaginary,  or  vice  versa. 

(e)  The  ability  to  reduce  noise  inside  the  object  support  via  the  positivity  constraint  is  a  function  not  only 
of  the  noise  prt^rties  but  also  of  the  magnitude  of  tte  noise*£ree  object.  This  again  is  a  reflection  of  the  &ct  that 
the  constraint  is  signal-dependent,  while  suiqwrt  is  not. 

(f)  The  noise  outside  the  suiqwrt  constraint  is  reduced  but  not  eliminated. 

(g)  The  image  data  SNR  must  be  ^roximately  1  or  less  for  both  positivity  and  support,  used  together  as 
constraints,  to  produce  a  noticeable  difference  from  just  using  support  as  a  constraint. 

A  draft  of  a  i»per  which  contains  the  details  of  the  positivity  results  is  in  Appendix  C. 

4.  Prior  high-quality  image  data  as  a  wnstrmt 

Recently,  it  has  been  prqx>sed^  that  perfect  knowledge  of  part  of  an  image  could  be  used  to  decrease  noise 
in  the  measured  image  outside  of  this  region  of  perfect  knowledge.  This  partial  perfect  knowledge  could  be 
obtained  by  either  prior  high-quality  image  data  or  by  conqmter  modeling  of  the  object.  This  constraint  was 
investigated  during  the  grant  and  these  results  were  gener^ized  to  allow  the  prior  l^owledge  to  be  noisy  as  long  as 
the  noise  is  miK:h  less  than  the  noise  in  the  measured  data.  It  was  shown  that  prior  high-quality  partial  knowledge 
behaves  effectively  as  a  suiqrort  constraint  As  a  result  all  the  conclusions  from  the  support  part  of  this  research 
apply  in  determining  the  ^ectiveness  of  using  prior  high-quaUty  image  data  as  a  constraint.  In  particular,  for 
wide-sense  stationary  Fourier  domain  noise,  the  differences  in  the  variances  of  the  real  and  imaginary  parts  of  the 
measured  data  must  differ  tty  more  than  60%  for  noise  reduction  to  occur,  and  the  noise  reduction  occurs  only  in 
the  asymmetric  part  of  the  siqrport  constraint. 

A  draft  of  the  p^r  which  contains  the  details  of  these  results  is  in  Appendix  D. 

5.  Surmort  constraints  anoUed  to  imagery  collected  using  adantive  optics 

Work  has  been  completed  in  sqpplying  these  theoretical  results  to  telesctqre  imagery  which  have  used 
additive  r^cs  (AO)  to  help  compensate  for  the  atmosphere^'^^.  The  noise  statistics  have  been  derived  for  both 
the  low  and  high  light  levels.  In  the  low  light  level  regime,  the  noise  is  due  to  photon  noise  and  CCD  read  noise. 
As  mentioned  in  section  2,  no  noise  reduction  is  expected  using  support  as  a  constraint  in  this  case  since  these  two 
types  of  noises  result  in  effectively  wide-sense  stationary  Fourier  domain  noise  with  the  variances  of  the  real  and 
imaginary  parts  of  the  noise  equal.  In  the  high  light  level  regime,  the  noise  is  due  to  imperfect  atmoqrheric 
compensation,  assuming  that  the  CQ)  read  noise  is  negligtble  in  this  case.  The  noises  in  this  case  are  not  wide- 
sense  stationary,  so  the  previmtsly  derived  theory  cannot  be  quantitatively  ajqrlied.  However,  it  can  be  used  to 
make  qualitative  judgments  on  the  effectiveness  of  support  constraints  for  noise  redirction.  The  mechanism  by 
idiich  suf^rt  results  in  noise  reduction  inside  the  support  constraint  is  through  increasing  some  of  the  variances 
of  the  iterated  Fourier  data  btyond  that  of  the  measured  Fourier  data.  For  wide-sense  stationary  noise,  this  only 
results  in  noise  reduction  in  tte  asymmetric  part  of  the  image  because  variance  increases  occur  only  because  of  the 
corqrling  of  the  real  and  the  imaginary  parts  of  the  Fourier  data  Ity  the  asymmetric  part  of  the  support  constraint. 
No  variance  increases  occurred  because  of  correlating  measured  real  data  with  itself  or  measured  imaginary  data 
with  itself  However,  for  non-stationary  noise,  variance  increases  are  possible  by  both  correlating  teal  (imaginary) 
data  with  real  (imaginary)  data  as  well  as  cotqrling  real  and  imaginary  data  together.  In  this  case,  it  is  necessary  to 
determine  not  only  the  "size  differences"  of  the  variances  of  the  data,  but  also  the  correlation  of  the  noises. 

A  standard  approach  to  improving  image  quality  is  to  deconvolve  out  the  blurring  function  caused  by  the 
telesoqpe/AO  and  rdrlur  the  image  with  a  point  spr^  fmetion  which  has  more  resolution  associated  with  it.  In 
this  case,  even  in  the  low-light  regime  the  noises  become  non-stationary,  so  exact  theoretical  predictions  of  error 
redaction  become  very  difficult  However,  qualitative  results  can  be  pr^cted  from  the  wide-sense  stationary  case. 
As  for  the  high-light  level  case,  the  key  is  the  correlation  of  the  sizes  of  the  variances  of  the  data  and  the 
correlation  of  the  noises. 

In  Appendix  E,  the  details  of  the  analysis  for  AO  data  is  presented.  It  is  shown  that  for  reasonably 
reserved  images,  the  noises  comqrting  the  Fourier  data  are  highly-correlated  in  the  high-light  level  case,  a^  thus 
little  or  no  noise  reduction  is  possible.  In  the  high-light  level  case,  the  variances  of  the  real  and  imaginary  parts  of 
the  Fourier  domain  noise  vary  quite  significantly,  so  more  noise  reduction  occurs  than  for  low-light  level  images. 
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However,  because  the  noises  are  so  highly  correlated,  variance  reductions  in  the  support  of  Uk  image  still  only 
averaged  10%.  In  the  low-light  level  case,  the  variances  of  the  real  and  imaginaiy  parts  of  the  Fourier  domain 
noise  are  virtually  ictentical,  so  very  little  noise  reduction  is  expeaed  to  occur  even  though  the  noises  can  be  highly 
uncorrelated. 

An  important  result  of  this  work  is  that  involving  tl^  structure  of  the  noise  in  the  reconstructed  images.  It 
was  shown  that,  if  the  iterated  Fourier  data  near  the  edge  of  the  measured  data  region  is  not  strongly  constrained  to 
match  the  measured  data,  the  correlation  effect  of  support  constraints  correlates  in  the  zeros  outside  the  measured 
data  region  and  significantly  distorts  the  iterated  data.  This  distortion  does  not  just  result  in  noise  increases  in  the 
image  domain,  it  can  result  in  obvious  artifacts  in  the  reconstructed  images.  As  shown  with  computer  simulations 
and  with  field  data,  when  sui^rt  constraints  were  enforced  using  a  cost  function  approach  instead  of  a  convex 
projections  approach,  these  image  domain  artifacts  showed  iv  as  decreased  energy  in  the  dim  parts  of  objects  and  a 
concentration  of  energy  into  small  regions.  This  is  especially  important  because  it  is  exactly  tMs  sort  of  behavior 
which  leads  people  to  claim  that  supenesolution  is  occurring!  For  star  fields,  one  expects  bright  points  on  dark 
badcgrounds,  and  this  is  exactly  how  this  artifact  can  manifest  itself.  However,  computer  simulations  were  run 
using  extended  objects,  and  thus  this  energy  concentration  effect  is  obviously  demonstrated  to  be  algorithmic 
artifiK:ts  rather  than  improved  resolution.  It  t^pears  likely  that  this  sort  of  artifact  can  show  up  more  consistently 
when  excessive  amounts  of  siqKrresolution  are  attenqked. 

This  work  is  being  acconq>Iished  in  collaboration  with  Captain  Mike  Roggemann,  who  is  an  assistant 
profisssor  of  physics  at  the  Air  Force  Institute  of  Technology,  Wright-Patterson  AFB,  OH  4S433.  In  addition,  this 
w<^  (altmg  with  all  the  work  being  accomplished  with  this  grant)  is  being  accomplished  with  the  end  purpose  of  it 
being  aiq)lied  to  data  collection  methods  b^g  develqied  by  peq>le  in  the  Advanc^  Imaging  Division,  Phillips 
Laboratory,  Kirtland  AFB,  NM.  The  point  of  contact  there  is  Richard  Carreras,  PL/LIMI,  Kirtland  AFB,  NM 
87117-6008. 

6.  Chronological  list  ofnublications  and  conference  papers 

C.L.  Matson  and  M.C.  Roggemann,  "Noise  reduction  in  ad^nive  q>tics  imagery  with  the  use  of  support 
constraints,"  to  be  submitted  to  Applied  Optics  and  to  be  presented  at  the  SPIE  conference  on  advanced  telesct^. 
Match  1994 

C.L.  Matson,  "Error  reduction  in  images  using  high-quality  prior  knowledge,"  to  be  submitted  to  C)pt.Eng.  and  to 
be  submitted  to  SPIE  conference  on  image  processing,  July  1994 

C.L.  Matson,  "Positivity  and  its  role  in  error  reduction  in  images,”  to  be  submitted  to  J.Opt.Soc.Am.A.  and  to  be 
submitted  to  a  conference  on  inverse  problems 

C.L.  Matson,  "Variance  reduction  in  Fourier  spectra  with  the  use  of  support  constraints,”  to  appear  in  the 
J.Opt.Soc.Am.A,  Jamiary  1994 

C.L.  Matson,  Tourier  q)ectrum  extrtqwlation  and  enhancement  using  s(q)port  constraint,”  to  ^jpear  in  the  IEEE 
Trans.  Signal  Proc.,  January  1994 

C.L.  Matson,  "Variance  reduction  in  Fourier  spectra  and  their  corresponding  images  via  support  constraints,"  Proc. 
SPIE,  vol.2029,  July  1993 

C.L.  Matson,  "Fourier  spectrum  extr:qx)lation  and  enhancement  using  5uiqx>rt  constraint,"  Proc.  SPIE,  vol.1767, 
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7.  Conclusions 

The  results  of  the  research  under  this  grant  have  been  theoretical  predictions  of  the  usefulness  of  three 
of  prior  information  (suiq>ort,  positivity,  and  high-quality  prior  image  data)  for  noise  reduction  insitte  the 
stq^rt  of  an  object  Because  previtms  work  showed  that  superresolution  has  a  negligible  effect  on  image  quality 
fm  images  which  are  at  all  resolved^,  the  focus  of  this  work  has  been  on  noise  reduction  in  the  measured  Fourier 
data.  It  has  been  shown  that  the  fundamental  w^  these  types  of  prior  knowledge  woik  to  reduce  noise  in  images  is 
condating  adjacent  Fourier  spectra  elenwnts.  As  a  re^t,  the  noise  corrupting  the  measured  Fourier  data  has  to 
satisfy  two  qualitative  prq>erties  for  significant  noise  reduction  to  occur:  (1)  the  correlation  width  of  the  noises 
must  be  much  less  than  the  correlation  imposed  by  the  prior  knowledge,  and  (2)  the  sizes  of  the  noise  variances 
inside  the  imposed  correlation  region  must  be  quite  dissimilar.  For  symmetric  support  constraints,  the  correlations 
only  occur  between  adjacent  real  or  adjacent  imaginaiy  components  of  the  Fourier  spectrum.  For  a^munetric 
siqiport  constraints,  correlations  are  also  induced  between  the  real  and  imaginaiy  parts  of  a  Fourier  spectrum 
element,  as  well. 
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Quantitative  theory  was  derived  for  wide-sense  stationary  Fourier  domain  noises  using  an  algorithm 
which  allowed  a  linear  analysis  to  be  acconqilished.  In  this  case,  the  magnitude  of  the  real  and  imaginary 
variatKes  are  independent  of  fipequency,  so  the  only  mechanism  for  noise  reduction  is  the  dissimilarity  of  the 
magnitude  of  the  real  and  imaginary  variances.  As  a  result,  noise  reduction  only  occurs  in  the  asynunetric  part  of 
the  enforced  siqiport  constraint  produced  by  using  positivity,  true  si^jport,  or  prior  high-quality  image  data  as 
constraints. 

This  theory  was  used  as  a  quali  ative  guide  for  non-stationary  Fourier  domain  noises  for  images  collected 
on  telescopes  with  adaptive  optics  for  removing  atmospheric  distortion.  Support  was  used  as  a  constraint.  In  the 
low-light  level  case,  with  the  telescqw  blur  function  d^nvolved  out  of  the  images,  it  was  predicted  qualitatively 
and  shown  via  computer  simulations  and  field  data  that  essentially  no  noise  reduction  occurs  because  of  correlation 
of  the  sizes  of  the  noise  variances  in  the  Fourier  domain,  even  though  the  noises  can  be  quite  uncorrelated.  In  the 
high-light  level  case,  the  magnitudes  of  the  real  and  imaginary  noise  variances  were  shown  to  be  quite  dissimilai , 
on  average,  but  the  noises  were  so  highly  correlated  relative  to  the  correlation  width  imposed  by  sui^rt  constraints 
that  again  little  noise  reduction  occurred,  although  more  occurred  than  in  the  low-light  level  case. 

Many  other  types  of  prior  knowledge  can  be  used  in  addition  to  the  ones  looked  at  in  this  research^. 
However,  support  and  positivity  are  the  most  widely  used  and  luidoubtedly  the  most  widely  recognized  as  the  most 
general  and  powerful  constraints.  Because  of  the  work  accomplished  under  this  grant,  it  is  expected  that 
essentially  all  prior  knowledge  will  function  to  produce  correlations  between  Fourier  spectrum  elements  as  the 
mechanism  for  noise  reduction  in  images.  As  a  result,  the  results  presented  above  should  generalize  in  a 
straightforward  way  to  other  types  of  prior  knowledge. 

The  most  irtq>ortant  result  to  come  out  of  this  work  is  that  it  is  the  Fourier  domain  noise  prqjerties  which 
dictate  the  effectiveness  of  prior  knowledge  to  improve  the  quality  of  images.  As  a  result,  in  a  qu^tative  sense, 
one  should  be  able  to  predict  a  priori  whether  or  not  prior  knowledge  will  result  in  significant  noise  reduction  in 
images  merely  by  determining  the  noise  prc^rties.  This  can  be  accomplished  easily  via  cotapater  simulations, 
especially  if  the  noises  are  too  complicate  for  their  properties  to  be  derived  analytically,  as  for  adaptive  (^tics 
noises. 
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The  use  ctf  siqqMtt  constraints  for  inq)roving  the  quality  of  Fourier  spectra  estimates  is  discussed  in  this  papa.  It  is 
shown  that  siq)enesolution  is  an  additive  phenomena  which  is  a  fimction  of  the  correlation  scale  induced  by  the 
support  constraint  and  is  independent  of  the  bandwidth  of  tte  measured  Fourier  spectrum.  It  is  also  shown  for 
power  qtectra  that  siq)port  constraints,  due  to  the  enforced  correlation  of  power  spectra,  reduce  the  variance  of 
measured  power  spectra.  These  theoretical  results  are  validated  via  computer  siimilation  in  the  area  of  q)edde 
interferometiy,  with  veiy  good  agreement  shown  between  theoiy  and  simulation. 
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1.  InttnHurtMMi 

The  use  of  ii^'^nnatkm  in  addition  to  measuitd  Fourier  data  to  improve  the  resolution  in  reconstructed 
signals  has  received  a  consideraUe  amount  of  attention  over  the  last  five  decades^’^’^.  The  kinds  of  additional 
infonnatioa  lineally  used  can  be  categttfized  in  two  ways:  flexible  constraints  and  rigid  constraints.  Flexible 
constraints  are  usually  used  to  reject  solutions  to  the  deconvolution  problem  (i.e.,  regularize  the  deconvolution 
jMoblem^)  which  are  unacceptable  because  they  include  lumnegligiMe  high  frequency  structure  which  results  from 
poise  rather  than  fiom  signal.  Because  it  is  impossible  to  accurately  reconstruct  a  ^race-limited  signal  which  is 
noiqr  fitun  any  finite  pmtkm  ot  its  Fourier  spectrum  due  to  the  infinite  extent  of  its  Fourier  transform,  these 
cmstiaints  are  flexible  since  arqr  reconstruction  will  be  inaccurate  (either  firom  noise  in  the  Fourier  data  or  fnm 
sidelobes  due  to  the  truncation  ^  the  signal's  Fourier  qrectrum).  This  flexibility  allows  one  to  trade  off  the 
structure  and  am|riitude  of  noise  in  the  reconstructed  signal  with  the  recovered  resolution  in  the  signal.  Rigid 
cnistraints,  tm  the  other  hand,  rdlect  information  about  the  signal  which  any  reconstruction  is  required  to  possess. 
Thus,  rigid  omstraints  define  an  accurately  known  sidiset  of  the  solution  qrace  that  reconstructed  signals  rruist 
reside  in,  and  flexible  constraints  define  unaocqrtable  regions  with  fitzzy  boundaries  within  this  subset. 

Usually,  flexible  constraints  are  some  form  of  smoothness  constraint  inqxrsed  on  the  reconstructed  signal. 
These  types  of  constraints  are  included  in  a  cost  function  definition  weighted  by  a  Lagrange  multiplier  which  is 
chosen  to  iHOvide  an  optinnim  tradeoff  between  nr^  and  resolution  in  the  reconstructed  signal  relative  to  a  chosen 
definitkMi  o£  optimality.  It  is  important  to  note  that  im|»Dving  resolutimi  in  this  context  means  decreasing  the 
point  qxead  fiinction  width,  not  increasing  the  bandwidth  of  accurately  known  Fourier  data.  Using  flexible 
emstraints  to  decrease  the  point  qnead  funetkm  width  does,  in  &ct,  increase  the  bartdwidth  of  the  Fourier  data,  but 
without  including  rigid  amstraints  (either  explicitly  or  implicitly),  the  new  Fourier  data  will  be  virtually  all  noise 
and  will  resuh  in  increased  nmse  levels  in  the  reconstruct^  sig^.  Empirical  evidence  suggests  that  point  qrread 
flmctimi  widths  can  be  decreased  by  a  fiKtor  of  two  or  more  as  compared  to  the  point  qnead  function  widths 
ooneqxmding  to  inverse  Fourier  trrmsfonning  truncated  Fourio'  da^  without  imposing  regularization  constraints. 
This  useful  decrease  in  point  spread  function  width  can  be  attributed  to  the  human  visual  system's  ability  to  rejea 
the  random  twise  which  acconqMUiies  decreased  point  qrread  fiinction  widths. 

The  other  category  of  additional  information,  rigid  constraints,  includes  information  about  the  signal  such 
as  its  region  of  support  and  the  fixrt  that  the  signal  is  nonnegative^*^,  if  apprt^riate.  Many  results  can  be  found  in 
the  literature  which  show  resolution  improvements  of  a  fiictor  of  two  or  more  when  support  and  nonnegativity 
constraints  are  qiplied.  However,  these  improvements  ate  usually  determined  by  reduc^  point  qnead  fiinction 
widths  and  not  iqxm  the  accurate  extension  of  measured  Fourier  data  beyond  the  maximum  measured  bandwidth. 
Thus,  these  inqiroveinents  imne  accurately  reflect  the  tradeoff  between  noise  and  robustness  using  flexible 
constraints  latto  than  actual  Fourier  data  extrqiolation.  Furthennore,  algorithm  results  fiom  which  these  claims 
are  derived  usually  come  fiom  testing  the  algorithms  with  finite  sums  of  point  sources.  As  will  be  shown, 
siqierresohitkm  can  be  achieved  quite  easily  using  siqipoit  constraints  with  point  sources  because  of  the  small 
q»oe-bandwidth  product  that  results  fiom  typical  point  source  support  cemstraints.  Another  result  that  will  be 
shown  is  that  superresolutum  using  siqiport  constraints  is  additive;  that  is,  a  finite  (small)  amount  of  Fourier 
spectrum  siqierresolution  can  be  accomplished  using  siqipoit  constraints,  and  this  superresolution  is  indqiendent  of 
the  bandwit^  of  the  measured  Fourier  data  if  the  support  constraint  is  based  iqxm  tlU  size  of  the  object.  Thus, 
achkvaUe  siqienesolutkm  as  measured  tty  accurate  extmision  of  measured  Fourier  qiectra  is  merely  a  small 
finctionofthebandwidthoftneasuredFourierqiectrafor  images  which  ate  at  all  resolved,  rather  than  being  a 
multiidicative  phenmnena  wdiich  is  a  function  of  the  measurement  bandwidth. 

Anotto  w^  that  stqiport  constraints  can  be  used  to  improve  measured  Fourier  qiectra  is  tty  decreasing 
the  variance  of  the  measurements  through  enforcing  correlations  among  the  Fourier  data.  Typically,  Fourier 
qiectia  ate  measured  pmntwise  without  including  correlation  among  the  Fourier  qiectra  datapoints.  ^qilying 
siqiport  emstraints  is  equivalent  to  enibreing  Fourier  domain  correlations  which  causes  interpixel  averaging,  and 
thte  averaging  reduces  the  variance  of  the  measurements.  In  this  paper,  mathematical  expressions  ate  derived 
which  predict  the  degree  dT  variance  reduclitm  as  a  function  of  the  relative  correlation  of  the  noise  and  the  support 
constraint  correlation  fiv  power  qiectrum  estimation.  To  demonstrate  the  validity  of  the  eiqitessions,  conqmter 
siimihttion  renhs  are  prerented  fin  the  case  d  estimating  the  power  qiectra  of  two  dimensional  objects  through 
atmoqdieric  turbuknoe,  and  achieved  variance  reductions  are  compart  to  theor^cal  predictions.  The 
organization  of  the  pqier  is  as  follows:  sectitm  2  contains  mathematical  results  which  predict  the  achievable 
superresc^ution  using  support  constraints,  section  3  contains  mathematical  results  predicting  the  variance  reduction 
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in  me^ured  power  spectrum  data  using  sui^rt  constraints,  section  4  has  results  from  the  computer  simulation, 
and  ocmclusions  can  be  found  in  section  3. 

2.  Supcncariittion 

Consider  the  following  one-dimensional  model  relating  the  true  object  intensity  distribution  o(x)  and  the 
measured  image  intensity  distribution  i(x); 

a/2 

i(x)  =  2fo  Jo(^)sinc{2fo(x-^)}d^  (1) 

-0/2 

This  model  corresponds  to  perfect  knowledge  of  the  true  object  Fourier  spectrum  inside  the  frequency  range  [■fg.fo] 
and  zeit^  it  out  everywhere  else.  The  image  is  then  obtained  by  inverse  Fourier  transforming  this  truncated 
spectrum  and  zeroing  out  the  resulting  image  intensity  distribution  outside  the  known  support  region  [-a/2,a/2]. 
Although  this  mottel  ignores  noise,  the  effects  of  noise  will  be  discussed  shortly. 

The  true  object  intensity  distribution  o(x)  can  be  recovered  exactly  from  Eq.(l)  for  noise  free  data  since 
the  operatkm  shown  in  Eq.(l)  is  invertible  (although  the  inverse  in  not  continuous).  A  convenient  conceptual 
approach  to  accomplishing  the  inversion  is  decomposing  both  i(x)  and  o(x)  into  infinite  sums  of  prolate 
spheroidal  wave  functimis'.  Let  V(ui(x)  be  the  n^  prolate  spheroidal  wave  function  (defined  on  [-a/2,oc/2]) 

cone^nding  to  the  space-bandwidth  product  IoIq  and  let  yn(x)  be  the  extension  of  VquiIx)  to  the  interval 
(.«e,ae).  Then,  because  i(x)  is  bandlimited,  it  can  be  expressed  as 

m 

i(x)  =  ^c„v„(x)  (2) 

where  each  coefficient  Cq  is  the  projection  of  i(x)  onto  Vofx)  and  is  given  by 

«• 

c„  =  Ji(4)V„(^)d4  (3) 

In  the  same  way,  because  o(x)  has  finite  suiqx>rt,  it  can  be  expressed  as 

m 

0(x)  =  5]d„Van(x)  (4) 

nsO 

and  the  expansion  coefficients  dQ  are  given  by 

0/2 

<in=^  teVoam  (5) 

"  -a/2 

where  the  Xq  are  the  eigenvalues  of  the  operator  given  by  Eg.(I),  and  thus  1/X„  are  the  eigenvalues  of  the  inverse 
operator.  Using  tlKse  decompositions,  it  can  be  shown  that'  o(x)  is  siven  by 


(6) 


The  inverse  of  the  operator  described  by  Eq.(l)  exists  because  all  of  its  eigenvalues  are  greater  than  zero,  but  the 
inverse  is  not  continuous  because  the  limit  point  of  the  ei^nvalues  is  zero.  As  a  result,  if  any  noise  exists  at  all, 
the  infinite  limit  in  Eq.(6)  must  be  replaced  by  some  finite  number  N,  where  N  is  determined  by  the  signal-to-noise 
ratio  (SNR)  of  the  meamred  data.  Therefore,  o(x)  can  be  ai^roximated  by^ 

N 

o(x)-  aa(x)  (7) 

n-0  “ 


Although  Eq.(7)  avoids  noise  an^ilification  by  truncating  the  series  shown  in  Eq.(6),  other  approaches  can  be 
taken^  which  attenuate  the  effect  of  the  decreasing  eigenvalues  instead  of  truncating  the  series. 

The  key  to  understanding  achievable  superresolution  is  understanding  the  dependence  of  the  magnitude  of 
the  eigenvalues  Xq  upon  ^  and  a.  It  has  been  shown^  that  the  eigenvalues  are  bounc^  above  by  one  for  all  n  and 
are  greater  than  approximately  0. 1  for  n^oi^.  Beyond  this  value  of  it,  the  eigenvalues  fall  off  quickly  at  a  fiiirly 
constant  rate  such  that  Xq/Xq+i  is  approximately  equal  to  ten.  Therefore,  assuming  a  moderate  SNR,  the 
maximum  size  that  N  in  Eq.(7)  can  be  without  magnifying  tl»  noise  excessively  is  2(xf^.  It  has  been  shown^> 
that  the  n^  prolate  qtheroidal  wave  function  results  in  an  image  domain  resolution  comparable  to  a  sine  fimction 
of  fiequency  (n-t-l)/2a  in  terms  of  the  average  distance  between  zero  crossings.  As  a  result,  the  spatial  frequency 
that  corresponds  to  N-2af^  is  given  by 


f„=(2af,+l)/2a 

=fo+l/2a 


(8) 


Recall  that  ^  is  the  maximum  spatial  fiequency  at  which  measured  Fourier  data  exists.  Therefore,  the  use  of 
support  constraints  results  in  superresolution  of  this  measured  data  1^  an  additive  amount  of  l/2a.  The  additional 
amount  is  23%  of  the  main  lobe  of  the  sine  function  which  is  the  Fourier  transform  of  the  support  constraint,  and 
the  siqiOTesolutiiHi  term  is  iiukpendent  of  fg.  Thus,  superresolution  via  support  constraint  enhancement  is 
additive  and  is  negligible  for  images  which  are  at  all  resolved  as  will  be  shown.  This  result  is  reasonably 
indqiendent  of  the  SNR  of  the  measured  data.  Because  the  eigenvalues  dn^  off  so  rapidly,  a  factor  of  ten  increase 
in  SNR  is  required  to  increase  N  by  one.  Even  if  it  is  possible  to  increase  the  SNR  by  several  orders  of  magnitude, 
the  result  is  ^  an  additive  superresolution  increase,  not  a  multiplicative  one. 

Consider  now  using  support  constraints  on  a  point  source.  Because  the  siq^rt  of  a  point  source  is  zero, 
by  (tefinidon,  su^xirt  constraints  are  usually  derived  fiom  the  point  spread  fimedon  corresponding  to  the 
bandwidth  of  the  measured  Fourier  data.  In  pardcular,  a  reasonable  support  constraint  is  obtained  by  setdng  the 
siqiport  width  equal  to  the  width  of  the  main  lobe  of  the  point  spread  fiincdon.  For  the  case  of  using  a  filter  which 
is  one  inside  and  zero  elsewhere,  the  point  spread  funedon  main  lobe  width  is  given  by  1/^  and  thus 
a-l/f^.  Subsdtudng  this  e?q)ression  into  Eq.(8)  results  in 


f„=f,+l/(2/f„) 

=  fo+fo/2 


(9) 


Now  the  achievable  supenesoludon  is  a  funedon  of  the  bandwidth  of  the  measured  Fourier  data  because  the 
siqiport  constraints  were  based  upon  the  bandwidth  of  the  Fourier  data,  and  results  in  a  50%  increase  in  bandwidth 
regardless  of  Since  most  algorithms  include  regularizadon  along  with  support  constraints,  the  resoludon  as 
measured  by  point  ^read  funedon  width  can  improve  by  a  fector  of  two  or  more  beyond  this  50%  improvement  as 
well.  Thus,  it  can  be  seen  that  summit  constraints  am>lied  to  point  source  images  along  with  regularizadon 
constraints  can  decrease  point  spre^  funedon  widths  in  recovered  imagery  by  a  fector  of  two  or  more.  However, 
this  apparent  improvement  must  be  kept  in  perspeedve.  By  choosing  a=l/f^,  the  space  bandwidth  product  equals 
two  indqiendent  of  ^  and  thus  N  in  Eq.(7)  is  alwt^  equal  to  two.  Therefore,  the  only  reason  the  increase  in 
resdudon  m’pears  large  because  it  is  being  conqxued  to  such  a  small  amount  of  measured  spatial  fiequency 
infixmadon  in  terms  of  the  space  bandwidth  pr^uct. 
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The  point  source  case  can  be  extended  to  analyze  the  efTect  support  constraints  have  upon  resolved  objects. 
Let  the  resolv^  object  be  X  point  sources  separated  from  each  other  by  the  Rayleigh  resolution  distance.  This  is 
equivalent  to  saying  that  there  are  X  resolution  cells  in  the  image.  Then  a=(X+l)/(2fQ),  where  the  siq^rt  region 
is  defined  as  the  distance  between  the  first  zeros  of  the  point  spread  function  on  either  end  of  the  resolved  object. 
Substituting  this  into  Eq.(8)  gives 


f  =f  + _ i _ 

"  °  2l(X+l)/2fJ 


(10) 


It  can  be  seen  that  the  superresolution  term  decreases  as  the  suj^rt  increases.  For  example,  if  there  were  9 
resolution  cells  in  the  image,  the  amount  of  superresolution  w(^d  be  10%.  If  there  were  99  resolution  cells  in  the 
image,  the  amount  of  siqrenesolution  would  be  only  1%.  This  shows  that  superresolution  is  negligible  for  objects 
which  are  at  all  resolved. 

An  extensive  analytic  and  conqwter  simulation  study  was  recently  acconq)lished^  ^  to  explore  the 
usefulness  of  siqrport  constraints  to  both  fill  in  holes  in  a  modulation  transfer  function  (MTF)  as  well  as  to 
extnqrolate  Fourier  data  bQvnd  the  maximum  measured  Fourier  data.  Least  squares  and  ntinimum  variance 
estimators  were  evaluated  as  well  as  a  Q£AN  algorithm  in  conjunction  with  siqrport  constraints.  The  object  to  be 
imaged  in  the  stuify  was  assumed  to  be  windowed  white  noise  with  variance  and  white  noise  was  added  to 
imaged  object  with  variance  The  data  were  assumed  to  have  a  SNR  of  over  300,  where  the  SNR  was  defined 
as  which  is  sufficiently  high  to  allow  N=2(xfQ-)-l  in  Eq.(7)  instead  of  the  previously  assumed  N=2a^.  As 

a  result,  the  siqrerresolution  term  in  Eq.(8)  becomes  1/a  instead  of  l/2a.  In  the  study,  a  wide  variety  of  siqrport 
constraints  were  used,  and  the  error  at  each  spatial  fiequency  between  the  true  ot^  spectrum  and  the  recovered 
object  ^Kctrum  was  calculated  for  each  support  constraint.  The  results  confirmed  that  the  ability  to  derive  Fourier 
information  in  regions  where  no  data  is  a\^dlable  depends  upon  1/a.  In  particular,  it  can  be  shown  from  the  results 
in  the  study  that  the  reduction  in  quality  of  the  extrapolated  Fourier  data  is  well  parameterized  tty  l/o,  both  in  the 
hcdes  of  the  MTF  as  well  as  btyond  the  cutoff  spatial  fiequency  of  the  MTF. 


3.  Variance  Rediicritwi 

Although  siqrport  constraints  do  not  allow  useful  superresolution  to  occur  for  well  resolved  objects,  th^ 
can  be  useful  in  reduci^  the  variance  of  measured  Fourier  data.  In  this  section,  theoretical  results  will  be  derh^ 
which  predict  the  variance  reduction  in  measured  Fourier  data  resulting  from  applying  support  constraints.  For 
simplicity,  the  theory  will  be  developed  for  power  qiectrum  estimation. 

Let  i(x)  and  I(u)  be  Fourier  transform  pairs,  where  x  and  u  are  n-dimensional  spatial  and  spatial  fiequencty 
vectors,  reqrectively,  and  i(x)  is  real.  Also,  let  the  autocorrelation  support  constraint  be  given  by  w(x).  Then,  Ity 
definition,  it  fi>Uows  that 

i(x)*i(x)=w(x)li(x)*i(x)]  (11) 


where  *  denotes  autocorrelation.  Fourier  transforming  both  sides  of  Eq.(l  1)  results  in 


|l(u)|'  =  Jw(^)|l(u-^)|'d^ 


(12) 


where  W(o)  is  the  Fourier  transform  of  w(x).  It  can  be  seen  from  Eq.(12)  that  the  power  spectrum  of  i(x)  at  aity 
qxttial  fie^iency  point  u  is  related  to  the  power  spectrum  at  every  other  ^tial  fiequency  point  via  the  convolution 
operation.  In  essence,  Eq.(12)  shows  that  applying  support  constraints  results  in  weighted  interpixel  averaging 
with  the  weights  given  tty  the  Fourier  transform  of  the  window  function.  Let  |Ie(u)p  be  the  pointwise  estimated 
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power  q)ectniin,  and  let  |Is(u)p  be  the  improved  power  spectrum  estimate  which  results  from  applying  support 
constraints  to  |Ie(u)p.  Th^  at  each  spatial  frequency  u.  it  follows  from  Eq.(  12)  that 

«• 

|l.(u)|^=  Jw(4)|l.(u-4)|^d4  (13) 

The  variance  of  |Is(u)|^,  var(|Is(u)|^),  is  given  by 
var(jl,(u)f )  =  <(|l.(u)j')^  >-<|l.(u)l' 

••  ••  MM 

=  <  Jw(§)|l.(u-§)|'d4jw(C)|l.(u-C)|'dC>  -  <  Jw(^)|Uu-4)|'d^x  Jw(C)|l.(u-C)|'dC> 


=  JJw(§)W(CX<|l.(u-4)|'|l.(u-tf  >  -  <ll.(u-5)|'x|l.(u-C)|">]d^C  (14) 


where  the  angle  bradcets  denote  expectation.  Furthermore,  assume  that  |Ie(u)|^  is  well  modeled  1^ 


|l,(u)|"=|0(u)j'+n(u)  (15) 

wdiere  |0(u)p  is  the  true  object  power  spectrum  and  n(tt)  is  zero  mean  wide  sense  stationary  noise  with  variance 
equal  to  o^,  and  thus  it  follows  that  var{|Ig(u)p}  =  o^.  Substituting  Eq.(lS)  into  Eq.(14)  gives 


var(|I,(u)|2)  =  JJw(^)W(C)^a^-^d^i;  (16) 

-«> 

wiiere  RnC^-O  “  <n(u-4)n(u-C)>  and  R|i(0)  =  o^.  It  can  be  seen  that  var{|l5(u)|2}  is  equal  to  var{llg(u)|2) 
multiplied  an  integral  &ctor  which  determines  the  amount  of  reduction  in  variance  caused  the  plication  of 
siqiport  constraints. 

Two  asynqitotic  cases  will  be  analyzed  to  help  gain  an  understanding  of  what  Eq.(16)  means  in  terms  of 
variance  reduction.  Consider  first  the  case  where  the  noise  autocorrelation  fru^on  is  much  broader  than  the 
Fourier  transform  of  the  siqiport  flinction.  This  is  equivalent  to  assuming  that  Rii(^-C)  *■  for  all  values  of  d  and 
%  fot  which  the  functions  W(^)  and  W(0  are  significantly  nonzero.  In  this  case,  Eq.(16)  can  be  ai^roximated 


var(jl.(u)|')-o*  JJw(C)W(^)d^C 


(17) 


Thus,  there  is  essentially  no  variance  reduction  from  iq)plying  suRWit  constraints  if  the  noise  correlation  is  much 
broader  than  the  Fourier  transform  of  the  support  constraints. 


Now  consider  the  other  asynq}totic  case  where  the  noise  autocorrelation  function  is  much  narrower  than 
the  Fourier  transform  of  the  support  ftiiurtion.  This  case  is  more  easily  analyzed  by  using  a  change  of  variables  in 
Eq.(16),  which  results  in 


var(ll,{u)|^)  =  I  |w(4+|)W(4-|)^^d^C 


(18) 


Because  Ro(0  is  much  narrower  than  either  W(  )  term,  the  C  dependence  of  the  W(  )  terms  can  be  neglected.  This 
gives 


var(|I.(u)!^)  -  JJw(4)W(4)^^d^C 

m  •» 

=  o^Jw(^)2d4j^j|^dC 


(19) 


The  second  integral  term  in  Eq.(19)  is  indq>endent  of  the  suiqx>rt  constraim  size,  while  the  first  term,  by  Parseval's 
theorem,  is  the  area  of  the  san>orL  This  shows  that  var{|Ij(u)p>  decreases  as  the  siq)port  area  decreases,  and 
eventually  asyn^Motes  to  zero  as  the  siq^rt  area  goes  to  zero.  Tlius,  the  amount  of  variance  reduction  depends 
both  iqx>n  the  siqjport  constraim  area  and  the  relative  correlation  of  the  noise  corrupting  the  measured  Fourier  data 
and  tlm  correlation  uiqx>sed  by  the  siqqmrt  constraints. 

An  area  of  research  in  which  siq^rt  constraints  are  used  quite  often  is  the  area  of  speckle 
interferometryi^.  Thereftne,  the  theoretical  results  develt^ted  in  this  section  will  be  analyzed  for  the  specific  case 
ofestimatiiig  the  power  qtectrum  of  an  object  through  atmoqrheric  turbulence.  The  average  power  qrectrum  of  the 
object  multiplied  the  tdescqie/atmosfdiere  power  qwctrum  transfin^  function,  <|l0(u)|^>,  is  calculated  I7 

>='ij  |;t|D.(u)f-N„l  (20) 

m<il 

where  M  is  the  total  number  of  fiames  of  data,  Dq|(u)  is  the  Fourier  transform  of  the  m^  fiame,  and  Ngj  is  the 
number  of  photons  in  the  m^  frame.  This  estimator  assumes  that  the  estimation  process  is  shot  noise  limited,  and 
thus  it  is  necessary  to  subtract  Njq  from  each  fiame  to  obtain  an  unbiased  estimate  of  the  power  qrectturtL 
Un^  the  standard  assunqrtion  of  isoplanicity,  it  follows  that  <|Ie(u)p>  is  given  I9 


<|I,(u)|S=  |0(u)j'<|T(u)|S  (21) 

r^iete  0(o)  is  the  true  object  Fourier  q)ectrum  and  <|T(u)p>  is  the  power  spectrum  transfer  function  of  the 
telescqre/atmosidiere  system  normalized  to  one  at  dc.  An  estimate  of  the  true  object  power  spectrum,  Pe(u)|^,  is 
obtained  by  dividing  both  sides  (MrEq.(21)  by  <jT(u)|^>,  which  yields 


When  the  estimation  process  is  shot  noise  limited,  in  the  low  light  level  regime,  ami  for  spatial 
fiv(|aencies  sufficiently  large  that  effects  of  the  "seeing  spike"  are  negligible,  it  has  been  shown^^  that  the 
autocovariance  of  <|Iq(u)|^>  is  given  by 

x|i.(Cf  > = lo(^-C)|'  >  (23) 

Notice  that  the  power  q)ectrum  noise  correlation  depends  only  upon  the  difference  of  ^  and  C  and  is  a  function  of 
the  true  object  power  qiectrum  and  the  telescope/atmosphere  power  spectrum  transfer  function.  Although 
<|t(u)|^>  is  most  accurately  calculated  by  solving  a  four-dimensional  integral  equation,  a  reasonably  accurate 
siiiqrlification  is  given 


:|T(u)|S  =  [A^+-^  +  B^f 


(24) 


The  coefficients  A  and  B  are  given  by 


A  =  'lD(u)ejqK-q(— )^> 

,  (25) 

B  =  0.4355(i)2TD(u)(l+L38(:i*-)®^]exp{-[2.5(-^)2r'} 

D  Xu  li, 

vriiete  rg  is  the  Fried  parameter  which  provides  a  measure  of  the  correlation  scale  of  the  atmosphere,  Tj)(u)  is  the 
diffiaction  limited  incoherent  teleso^  transfer  function,  D  is  the  telescope  diameter,  X  is  the  observational 
wavdength,  and  q  is  a  function  of  D/r^  and  can  be  aiqrroximated  1^ 


q - 1 - -  (26) 

0.175 14 -0.000078(—) 

fitr  30  <  D/Iq  <  170.  As  D/Tq  approaches  infini^,  Eq.(24)  does  not  hold  and  q  ^rproaches  the  more  well  known 
constant  6.88.  Also,  this  qrproximation  for  q  beiromes  less  accurate  the  smaller  D/tq  becomes^^,  with  an 
inaccuraqr  of  qrproximatefy  10%  for  D/rg=30.  For  typical  values  of  rg  (*  10cm  at  X=550iun)  and  D  (Im  to  4m), 
tulren  observing  in  the  visiUe  wavelengths,  the  dominant  effect  governing  the  correlation  scale  in  Eq.(23)  is  the 
exponential  term  in  foctor  A.  Under  these  conditions,  if  the  siqrport  of  the  true  objea  is  much  smaller  th^  the 
seeing  disk,  which  is  defined  as  X/r^^  the  resulting  variance  given  by  Eq.(14)  will  approm;h  zero.  If  the  stqrport  of 
the  otgect  is  much  lugger  than  the  seeing  disk,  ^plying  srqiport  constraints  will  result  in  very  little  reduction  of  the 
variance.  Although  the  power  spectrum  term  |0(u)p  in  Eq.(23)  provides  some  decorrelation  for  large  objects,  and 
thus  slows  down  the  increase  in  variance  as  the  support  increases,  eventually  var{|Ig(u)p}  asyrrquotes  to 
var{|Ie(u)|2}. 

Because  |0^u)r,  and  not  |L(u)p,  is  what  is  estimated  in  qreckle  interferometry,  it  is  necessary  to 
determine  the  covariatKe  of  |Oe(u)r  firtra  the  covariance  of  |le(u)p.  It  is  ea^  to  show  ^t 

<|o.(4)f|o.(Cf  >-<Mf  xMf  >  °  ^  O’) 

<|t(q  ><K)|  > 

The  effect  the  mmstationary  tnms  have  upon  the  variance  reduction  integral  can  be  determined  by  substituting 
Eq.(27)  into  Eq.(14),  whidi  gives 


(28) 


— OO 

Because  <|t(tt)P>  is  a  slowly  varying  function  for  the  frequencies  for  which  Eq.(23)  is  valid,  and  the  numerator  is 
a  strong  fiinctitm  of  (^-0,  bMh  terms  in  the  denominator  of  the  integrand  are  essentially  independent  of  ^  and  C 
and  can  be  brought  outside  of  the  integral,  which  results  in 


var(ll.(u)|^ )  =  - f  f  W(^)W(C)|0(4- C)|'  C)l'  >  d^C  (29) 

<|t(u)|2>2  J  J 

“OO 

This  equatum  will  be  used  for  comparing  the  computer  simulation  results  in  the  next  section  to  theoretical 
predictions. 

4.  CoflaulCT  SiamlatiQa  Results 

To  determine  the  accuracy  of  the  theoretical  predictions  developed  in  section  3,  a  computer  simulation 
im^ram  was  used  to  generate  sequences  of  atmo^here  and  shot  noise  comqrted  images.  Average  power 
specbnms  of  these  images  were  odculated  using  Eq.(20),  and  the  atmosphere/telesct^  attenuation  effects  were 
removed  fiom  image  power  q)ectniins  using  Eq.(22),  where  estimated  system  power  qiectnun  transfer  functions 
were  obtained  using  an  unresolved  star  as  the  true  object  in  the  conqniter  simulation.  The  parameters  for  the 
unreserved  star  siinulation  run  were  chosen  so  that  the  estimated  system  power  q)ectrum  had  a  much  higher  SNR 
than  the  estimated  image  power  spectrum,  where  the  power  spectrum  SI^  was  c^culated  as  the  sample  mean 
divided  by  the  square  root  the  sample  variance  at  each  iqia^  fitequency.  Tlus  was  done  so  that  the  variances  of 
the  estimated  abject  power  spectrum  points  were  a  function  only  of  the  image  power  spectrum  estimate.  Sample 
variances  (rf*  the  power  q)ectrum  estimates  were  also  calculated  for  use  in  the  deconvolution  algorithm. 

The  first  step  Udeen  to  validate  the  theoretical  expre^ons  was  to  conqMte  the  predicted  power  q)ectrum 
cmelation  (Eqs.(23)K26))  against  both  conqxiter  simulated  and  field  data.  The  field  data  used  was  collected  on 
the  (unresolved)  single  star  Zeta  Delphinus  using  a  photon  cminting  camera  from  the  Stanford  Center  for  Space 
and  Astroid^cs^^  mounted  on  the  Kitt  Peak  Steward  Observatory  2.3m  telesctqre.  The  observing  wavelength 
was  SSOnm  and  the  qrectral  band^nss  was  30nm.  There  were  an  average  of  292  photons  per  frame  and  2500 
frames  were  used  in  estimating  the  correlation  coefficient  of  the  power  qrectrum  correlation.  Extensive  analysis^^ 
of  the  data  resulted  in  an  estimated  value  for  r^  of  10.5cm.  As  noted  in  section  3,  the  power  qrectrum  correlation 
coefBdent  depends  only  tqxm  the  difference  of  spatial  frequencies,  not  their  actual  values.  As  a  result,  the 
correlation  coefficient  curve  for  the  estimated  power  spectrum  of  Zeta  Delphinus  was  calculated  using  sanqrle 
statistics  fru  several  different  center  spatial  fie^piencies  and  the  results  were  averaged  together.  The  center  spatial 
firequendes  were  chosen  to  be  fiu  enough  away  from  dc  that  the  assunqjtions  used  in  deriving  Eqs.(23H26)  were 
satined  and  such  that  the  SNRs  of  the  power  qwetrum  at  these  frequencies  were  above  one  so  that  the  estimates  of 
the  ocHTdation  coefficients  would  be  accurate.  The  resulting  correlation  coefficient  curve  is  shown  in  Fig.  1  along 
with  the  coeflBcient  carves  obtained  by  using  the  computer  simulation  code  and  theoretical  predictions.  Notice 

that  the  amulation  and  theoretical  corves  differ  by  a  small  amount  at  all  spatial  ^uency  differences,  and  that  the 
field  data  curve  matches  the  simulation  curve  at  small  differences  and  the  theory  curve  at  larger  differences.  Thus 
it  can  be  seen  that  the  field  and  simulation  results  match  theoretical  predictions  quite  well.  However,  since 
theoretical  predictitms  will  be  c(Miq>ared  to  simulatitm  results,  it  is  necessary  to  refine  the  parameters  in  the 
theoretical  erqnessimis  to  provide  a  closer  fit  between  simulation  and  theory.  To  this  end,  the  q  parameter  was 
chosen  not  on  the  basis  of  Eq.(26),  but  so  that  the  theory  curve  would  agree  with  the  simulation  curve.  The  best  fit 
was  frrund  to  occur  with  q=4.6  as  corrtpared  to  the  predicted  value  of  5.77,  and  Fig.2  shows  the  two  curves.  Notice 
the  very  dose  match  now  between  theory  and  sirmtlation.  As  discussed  in  the  previous  section,  Eq.(26)  becomes 
less  accurate  as  D/r^  decreases  with  a  10%  mismatch  for  D/ro=30.  For  this  simulation  D/rQ-22,  so  tire  mismatch 
between  themy  and  simulation  was  erqrected. 


Next,  an  algorithm  was  developed  to  estimate  the  autocorrelation  from  its  power  spectrum  while  using 
support  constraints.  A  wide  variety  of  ^gorithms  have  been  prqx)sed  that  could  have  been  used^’^>  however, 
most  of  these  algimthms  mix  the  api^cation  of  support  conriraints  and  regularization  constraints  in  such  a  way 
that  it  is  inqwsable  to  determine  which  constraint  caused  the  observed  changes  in  the  power  qwctrum.  For  th^ 
reason,  a  simple  deconvdudon  algorithm  was  devised.  First,  it  was  determined  what  portion  of  the  power 
spectrum  was  estimated  with  a  SNR  greater  than  one.  Because  only  circularly  symmetric  objects  were  used,  this 
regkm  was  defined  as  a  circle  centered  at  dc  with  a  radius  de{wndent  iqx>n  the  SNR.  The  deconvolutions 
were  acooiiq>lished  by  minimizing  the  following  cost  function; 

««  [|0(«lf  -F(»)|0.(uf  f  ICXaf  f  (30) 

where  o^fu)^  is  the  sample  variance  of  the  power  spectrum  estimate  at  u,  the  minimization  is  accomplished  over 
all  powa  q)ectrums  |0(u)|^  whose  corresponding  autocorrelations  are  within  the  siqiport  given  by  w(x),  and  o.  is 
the  average  of  the  variances  for  luh^^nr  and  serves  the  function  oi  a  Lagrange  multiplier  for  the  regularization 
term.  The  first  summation  is  the  data  matching  term,  and  the  second  summation  is  the  regularization  term. 

Notice  that  the  r^ularization  process  only  involves  qxitial  frequencies  at  which  no  data  matching  is  to  occur,  and 
thus  the  effect  of  regularization  is  decoupled  from  the  effect  of  sun>ort  constraints  except  for  siq)poTt-induced 
correlations  near  the  boundary  defined  Rmr.  Therefore,  by  conq>aring  the  recovered  power  qrectrum  to  the 
measured  power  spectrum  sufficiently  frir  inside  the  circle  defined  I^qj.  so  that  siq^rt-induc^  correlations 
invrdving  spatial  frequencies  u  for  tu|^Rsnr  ^  negligible,  the  inq>rovement  by  using  support  constraints  can  be 
calculated.  In  order  to  smooth  the  transition  between  the  two  summations,  a  ffiter  F(u)  was  used  to  multiply  the 
measured  power  spectrum,  and  thus  the  sample  variances  must  be  multiplied  by  F(u)r.  For  these  simulation 
results,  the  smoot^g  filter  F(u)  was  defined  by 


=  (31) 

where  is  a  Bessel  function  of  the  first  kind,  order  one,  and  the  scaling  parameter  fi  was  chosen  so  that  the  first 
zero  cf  the  filter  occurred  where  the  power  spectrum  SNR  was  ai^roximately  0.5.  This  filter  was  chosen  because 
the  inverse  Fourier  transform  of  F(u)  has  finite  siqqx>Tt,  and  thus  siqqx>rt  constraints  can  be  aiq>lied  in  a  manner 
consistent  with  the  cost  functioa 

The  minimization  of  Eq.(30)  was  accortqtlished  using  an  IMSL  conji^ate  gradient  routine  with  a  user 
siqipikd  cost  function  and  gradient.  All  the  minimizations  were  given  300  stqrs.  The  cost  functions  were  reduced 
a  focttu’  of  20  on  average  fixnn  begirming  to  end,  and  the  norm  squared  of  the  gradient  alw^  decreased  at  least  six 
cadets  of  magnitude.  The  starting  point  for  the  minimization  was  the  inverse  Fourier  transform  of  F(u)Pe(u)|^. 

At  the  end  of  each  minimization,  tte  support-constrained  power  spectrum  estimate  Ps(u)|^  was  divided  by  F(u) 
and  a  sanqrie  variance  at  eadi  spatial  frequency  was  determined  by  calculating  the  mean  square  difference  between 
the  true  and  estimated  power  qrectrums.  Because  the  noise  processes  and  the  true  object  power  q>ectTa  were 
always  drculatly  symmetric,  all  the  variances  with  the  same  ^tial  frequency  magnitudes  were  averaged  together, 
which  resulted  in  sanqile  variances  as  a  function  of  |u| .  The  same  averaging  was  done  for  the  sample  variances  of 
Pe(u)l^>  ^  ^  sample  variances  of  |Os(u)p  for  each  |u|  were  divided  by  the  sample  variances  of  |Og(u)p.  These 
variance  reduction  fri^ors  were  then  averaged  together  to  finally  obtain  a  single  number  characterizing  the 
variance  reduction  that  occurred  as  a  result  of  tqq>lying  suiqrort  constraints. 

For  the  first  computer  sirQulation  cotiqrarison,  an  unresolved  star  was  used  for  the  true  6t^.  The 
sirtnilatkmpatametBts  were  as  follows:  ro»llcm,I>‘2.3in,M»2000,  and  2(X)  photons/frame  on  average.  An 
estimated  object  power  spectrum  was  calculated  using  Eq.(22),  and  then  the  deronvolution  algorithm  was  used  for 
a  variety  of  dra^  siqjport  constraints  with  diameters  tanging  firom  O^SX/Tq  to  4A7Jtq.  The  resulting  variance 
reduction  fiKtma  can  be  seen  in  Fig.3,  where  a  normalized  variance  of  1.0  indicates  no  variance  reduction.  Notice 
how  well  theory  and  sirmilation  results  match  for  values  of  the  sufqxtrt  diameters  which  were  less  than  2.5\Jtq. 

For  larger  stqspmt  diameters,  the  simolation  results  show  a  slightly  larger  normalized  variance  than  theoretic^ 
predktkms,  but  the  match  is  still  quite  good.  One  possible  reason  for  the  mismatch  in  this  region  is  that  the  main 


lobe  of  the  Fourier  transform  of  the  suiqwit  constraint  is  only  four  to  six  pixels  wide  in  this  region,  and  thus  coarse 
sampling  could  be  contributing  to  a  higher  variance.  It  can  be  seen  that  the  normalized  variance  does  go  to  zero  as 
the  siqtport  diameter  becomes  small  relative  to  the  seeing  disk  diameter  (and  thus  the  noise  correlation),  and  that 
the  normalized  variance  starts  to  asymptote  to  one  when  the  support  diameter  is  three  times  the  seeing  disk 
diameter.  Thus  it  appears,  as  expected,  that  the  determining  fhctor  in  the  usefulness  of  su^wri  constraints  is  the 
relative  size  of  the  noise  conelation  function  in  the  Fourier  domain  and  the  main  lobe  of  tte  Fourier  transform  of 
the  siqiport  fiinctitm. 

The  sectmd  cmiqmter  simulation  comparison  was  accomplished  to  validate  the  theoretical  expressions  for 
a  resolved  object.  A  case  which  is  essentially  (^posite  to  the  unresolved  star  case  is  that  of  an  object  which  is  a 
uniform  intensity  disk.  This  object  has  a  power  spectrum  whose  folloff  near  dc  is  very  steq),  unlike  an  umesolved 
star  udikh  has  a  constant  power  q)ectrum  independent  of  frequency.  By  Eq.(23),  the  noise  correlation  should  fall 
off  foster  than  for  an  unresolved  star,  and  thus  the  nomuilized  variance  should  rise  slower  as  the  support  size 
increases  than  for  the  unresolved  star.  However,  a  uniform  intensity  disk  has  zeros  in  its  power  q)ectrum,  so  a 
point  source  with  10%  of  the  intensity  of  the  disk  was  added  to  remove  these  zeros  without  greatly  affecting  the 
shiqje  of  the  didc  power  q)ectrum  near  dc.  This  allowed  the  saiiq>le  variance  reduction  calculations  to  proceed 
more  smoothly.  Next,  a  series  of  computer  simulations  were  acconq>lished  for  disks  with  diameters  ranging  ffmn 
0.2SXA’o  to  2A/rg.  The  deconvolution  algorithm  was  run  for  each  of  these  cases,  with  sui^rt  constraint  diameters 
ranging  fiom  0.6X/rQ  to  AA'klxQ,  where  the  increase  in  sui^rt  constraint  diameters  reflects  the  tact  that  the 
autocmrelation  siq^rt  is  twice  the  diam^r  of  the  object,  and  the  addition  of  a  small  guard  band  resulting  from 
the  oonvdution  of  the  support  with  the  inverse  Fourier  transform  of  F(u).  The  results  can  be  seen  in  Fig.4,  where 
again  there  is  very  good  agreement  between  theory  ami  simulation.  Notice  that,  conq>ared  to  the  unresolved  star 
case,  the  rise  in  the  normalized  variance  is  slower,  but  eventually  the  normalized  variance  ai^roaches  one  as  well. 
The  theory  and  simulation  curves  don't  match  as  well  as  for  the  umesolved  star  case  in  the  region  where  the 
siqiport  diameters  are  less  than  l.SXItQ,  although  the  difference  is  small.  A  probable  reason  for  the  mismatch  in 
these  cases  is  that  the  theoretical  curve  assumes  perfect  disks,  while  the  simulation  results  used  discretized 
versitms,  and  for  small  normalized  siqqMit  dianMsters  the  discrete  aiq>roximation  to  dirics  is  not  extremely  accurate. 
This  was  not  a  problem  for  the  unresolWl  star  case  because  the  power  qiectrum  was  one  at  all  spatial  fi^uencies 
and  thus  did  not  suffer  discretizaticm  problems. 

The  improvement  in  the  SNR  of  power  q)ectrum  estimation  as  a  result  of  applying  siqqwrt  constraints  is  a 
fonctkm  of  the  square  root  of  the  normalized  variance.  For  an  object  whose  autocorrelation  siqrpmt  is  the  size  of 
the  seeing  disk,  an  SNR  inqirovemem  of  approximatety  two  is  achieved,  which  indicates  that  large  inq>rovements 
in  SNR  using  siq)port  constraints  are  not  rustic  for  rejects  which  are  reasonably  large.  Another  interesting  point 
is  that  the  SNR  pr(^)erties  of  power  spectrum  estimation  in  spedde  interferometry  get  worse  as  r^  decreases,  Init 
the  improvement  in  power  q)ecttum  SNR  achieved  by  an>lying  suj^rt  constraints  increases  as  r^  decreases. 

Thus,  the  use  of  support  constraints  helps  offiet  the  ^ects  of  incrrased  atmospheric  turbulence. 

5.  Conclusions 

It  was  shown  that  siqierresolution  using  support  constraints  is  an  additive  process,  with  the  amount  of 
achievable  siq)eiresoIution  equal  to  25%  of  the  main  lobe  width  oi  the  Fmirier  transform  of  the  su{q)ort  function 
when  the  measured  Fourier  have  a  moderate  SNR  For  olgects  which  are  at  all  resolved,  this  amount  of 
superresolution  is  virtually  urmoticeable.  It  was  also  shown  that  su]qx>rt  constraints  are  useful  in  reducing  the 
variance  of  the  measured  Fourier  data,  with  the  amount  of  variance  reduction  dq)endent  upon  the  relative  size  of 
the  noise  conelation  and  the  correlation  enforced  by  the  support  constraint. 

Because  all  siqierresolution  tqqHoaches  attempt  to  derive  additional  Fourier  data  from  measured  Fourier 
data,  it  is  clear  that  enforced  correlations  are  the  mechanism  for  siq)erresolution.  As  a  result,  all  siqieiresolution 
should  be  additive  in  nature,  and  thus  it  is  not  realistic  to  expect  significant  amounts  of  accurately  extrapolated 
Fourier  q)ectra  regardless  of  the  constraint  aiqtlied. 
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Fig.  1 ;  Three  correlation  coefficient  curves  for  unresolved  star  power  spectra:  results  from  Held  data  collected  on 
Zeta  Delphinus,  computer  simulation  prediction,  and  theoretic^  prediction.  The  horizontal  axis  is  angular 
frequency  divided  by  the  seeing  cutoff  angular  frequency  r^/X. 


Fig.2:  Two  correlation  coefficient  curves  for  unresolved  star  power  spectra:  computer  simulated  prediction  from 
Fig.l  and  improved  theoretical  prediction.  The  horizontal  axis  is  angular  frequency  divided  by  the  seeing  cutoff 
angular  frequency  Xf/K. 
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Fig.3:  Variance  reduction  curves  for  a  point  source  true  object:  theoretical  predictions  and  results  achieved  from 
computer  simulations.  The  horizontal  axis  is  support  diameter  divided  by  the  seeing  disk  diameter  X/r^,  and  the 
vertical  axis  is  the  reduced  variance  achieved  applying  support  constraints  divided  tiy  the  variance  obtained 
without  using  support  constraints.  The  triangles  in  the  simulation  curve  are  actual  datapoints. 
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Normalized  Support  Dlometer 

Fig.4:  Variance  reduction  curves  for  a  disk  plus  point  source  true  otgect:  theoretical  predictions  and  results 
achieved  fiom  computer  simulations.  The  horizontal  axis  is  support  diam^er  divided  by  the  seeing  disk  diameter 
X/Tq,  and  the  vertic^  axis  is  the  reduced  variance  achieved  by  applying  sui^rt  constraints  divided  by  the  variance 
obtained  witlraut  using  support  constraints.  The  triangles  in  the  simulation  curve  are  actual  datapoints. 
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Abstract 

The  use  of  support  constraints  for  inqrroving  the  quality  of  Fourier  spectra,  their  associated  images,  and  the 
relationship  bttween  the  two  domains  is  discussed  in  t^  paper.  Heretical  relationships  are  derived  which 
predict  the  noise  reduction  in  both  the  image  domain  and  the  Fourier  domain  achieved  single  and  repeated 
application  d  siqiport  constraints  for  the  case  ai  wide  sense  stationary  Fourier  domain  noise.  It  is  shown  that  the 
application  of  siqtport  constraints  can  increase  noise  inside  the  siqjpoit  constraint  if  the  application  is  not  done 
cmiectly.  An  iterative  algmithm  is  proposed  which  enforces  support  constraints  in  such  a  way  that  noise  is  never 
increased  inside  the  siqtpoit  constraint  and  the  algorithm  achieves  the  minimum  possible  noise  in  a  finite  number 
of  steps. 
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1.  latroductioa 

The  use  of  information  in  addition  to  measured  Fourier  data  to  improve  the  resolution  in  reconstructed 
signals  has  received  a  considerable  amount  of  attention  over  the  last  five  decades  In  particular,  support 
constraints  have  been  used  in  a  variety  of  algorithms'*^  both  to  achieve  supenesolution  and  to  reduce  the  noise 
corrupting  the  measured  data.  In  the  area  of  supenesolution,  it  has  been  shown  that  support  constraints  allow 
some  spectral  extrapolation  to  occur,  but  the  amount  of  superresolution  is  less  than  a  resolution  element  for  data 
with  moderate  signid-to-noise  ratios These  superresolution  results  have  been  shown  to  be  fimdamental  limits 
imposed  by  the  quality  of  the  measured  data.  In  addition,  the  use  of  support  constraints  has  been  shown  to  reduce 
the  noise  in  measured  power  spectra^.  However,  this  woiic  did  not  discuss  the  effect  that  the  noise  reduction  in  the 
power  plectrum  had  upon  its  inverse  Fourier  transform,  the  autocorrelation  function. 

In  this  paper,  the  work  discussed  in  Ref.  [7]  is  extended  from  power  spectra  to  Fourier  spectra  which  are 
corrupted  by  wide  sense  stationary  noise.  Furthermore,  the  image  domain  consequences  of  applying  support 
constraints  in  a  repeated  manner  while  requiring  the  Fourier  plectra  of  the  suf^rt  constrained  images  to  stay  close 
to  the  measured  data  is  discussed.  It  is  shown  that  the  use  of  support  constraints  can  result  in  increased  noise  in 
the  image  domain  inside  the  support  constraint  if  the  support  constraints  are  not  enforced  in  an  optimal  manner. 

In  this  paper,  an  algorithm  is  prqxised  which  enforces  su(q>ort  constraints  in  such  a  way  that  noise  inside  the 
siqjport  constraint  is  never  increased  and,  when  noise  reduction  is  possible,  achieve  the  minimum  noise  in  a  finite 
nui^r  of  stqis. 

The  outline  of  the  paper  is  as  follows:  Section  2  contains  the  theory  for  variance  reduction  in  the  Fourier 
domain  as  a  result  of  one  tqiplication  of  su|^rt  constraints,  section  3  contains  results  for  variance  reduction  in 
both  the  Fourier  and  image  domain  as  a  re^t  of  repeated  application  of  sufqxrrt  constraints,  section  4  contains 
simulation  results,  and  the  conclusions  are  in  section  S. 


This  section  contains  results  which  predict  the  variance  reduction  in  the  Fourier  domain  as  a  result  of  one 
application  of  siq^rt  constraints.  Let  o(x)  and  0(u)  be  Fourier  transform  pairs,  where  x  and  u  are  n-dimensional 
qratial  and  ^tial  frequency  vectors,  reiqrectively,  and  o(x)  is  real.  Also,  let  the  support  constraint  be  given  by 
^x),  which  also  is  real.  Then,  by  definition,  it  follows  that 


o(x)  =  w(x)o(x) 


Founer  transforming  both  sides  of  Eq.(l)  results  in 


0(u)=  Jw(^)0(u-^)d^  (2) 


where  W(u)  is  the  Fourier  transform  of  w(x).  It  can  be  seen  from  Eq.(2)  that  the  Fourier  spectrum  of  o(x)  at  ary 
spatial  fiequency  point  u  is  related  to  the  Fourier  spectrum  at  every  other  spatial  fiuquetKy  point  via  the 
convdution  operation.  In  essence,  Eq.(2)  shows  that  applying  suf^rt  constraints  r^ults  in  weighted  interpixel 
averaging  with  the  weights  given  by  the  Fourier  transform  of  the  wimiow  function.  Let  O^Cu)  be  the  pointwise 
estimated  Fourier  qrectrum,  and  let  OgCu)  be  the  improved  Fourier  spectrum  estimate  which  results  from  tq^lying 
support  constraints  to  Ogfu).  Then,  at  each  spatial  frequency  u,  it  follows  from  Eq.(2)  that 


0.(U)=  |w(^)Oe(U-^)d^ 


=  |w,(4)0„(u-^Xi4-  Jw.(§)0ju-4)d4 


+  J 


Jw,(4)0,(u  -  ^)d^+  J  w,(^)0„(u  - 


(3) 


where  the  subsciipU  r  and  i  indicate  the  real  and  imaginaiy  parts  of  the  variables,  respectively. 

It  is  necessary  to  calculate  the  variance  of  Oj(u)  in  order  to  determine  the  effect  support  constraints  have 
upon  the  measured  Fourier  spectra.  Because  Ogfu)  is  a  complex  munber  for  each  u,  it  is  necessary  to  calculate  the 
variance  of  both  the  real  and  imaginary  parts.  The  variance  of  O^ffu),  var{Osf(u)},  is  given  by 

var{0,(u)}  =  <  [0,(u)f  >  -  <  0„(u) 


=  <  Jw^(^)0^(u-§)d4jw(;)0^(u-C)dC> 


<  Jw^(^)0^(u-^)d4x  Jw^(C)0^(u-C)dC> 


+  <fw.(^)Oju-^)d^fw.(C)Oju-C)dC>  -  <Jw.a)OJtt-^)d^xJw.(C)OJu-CXi;> 


^  MM 

-  2<  Jw(^X)„(u-§)d^Jw.(CX)>-C)dC>  +  2<  Jw(^)0^(u-^)d^x|w.(CX)>-i;)dC> 


=  JJw^(4)W^(C)[<O^(u-^)O^(u-C)>-<O^(u-^)xO^(u-0>]d^C 


+  J/ Wi(  W  (C)[<  0^(U  -^)0^(u  -  C)>  -<  0«(o  -  ^)  X  0„(u  -  C)  >]d^c 


-  2  /Jw,(4)Wi(C)[<O„(u-5X)«(u-0>-<O„(u-4)xO^(u-C)>]d4dC 


(4) 


where  the  angle  bradiets  denote  expectation.  Similarly,  it  follows  that 


var{0„(u)}  -  <  (O^(u)f  >  -  < 0^(u) 


=  J  J  W,(  W(C)(<  0„(u  -  ^X).i(u  -  C)  >  -<  0„{u  -^)  X  0„(u-  C)  >]d4dC 


+  J  J  %(%)%  (C)l<  0„(u  -§)0„(u  -  C)>  -<  0„(u  -  ^)  X  0„(u  -  0  >]d^C 


+  2  J  J  W,(^)Wi(C)[<  0^(u  -  4)0„(u  -0>-<  0„(u  -4)  X  0„(u  -  C)  >]d4dC  (5) 


To  analyze  these  equations  further,  mote  information  needs  to  be  known  about  O^Cu)  in  order  that  the  e>q)ectations 
in  Eqs.(4)  and  (S)  can  be  evaluated.  Therefore,  define 

N,(u)  =  0„(u)-(0„(u)) 

Ni(u)  =  0^(u)-(0,,(u)) 

where  the  conqtlex  noise  (Nf,N|)  is  a  stochastic  process  which  satisfies 

{N,(u,)N,(U2))  =  R,(u,-U2)  +  Rr(U,+U2) 

(Ni(U,)Ni(U2))  =  Rj(U,-U2)-Ri(U,+U2)  (7) 

(Ni(u,)N,(U2)}  =  (N,(u,)Ni(u2)>  =  0 


This  model  for  the  noise  is  general  enough  to  include  both  CCD  read  noise  and  Poisson  noise.  The  restriction  that 
the  covariance  between  the  real  and  the  imaginary  is  zero  irtqrlies  that  the  variance  of  the  noise  in  the  image 
domain  is  an  even  function  of  x.  This  restriction  is  made  for  clarity  and  simplicity.  Also,  for  clarity  and 
simplicity,  the  terms  in  Eq.(7)  which  ate  functions  of  U|+U2  will  be  neglected  since,  in  general,  thdr  influence  is 
telairvely  minor  for  all  fiequencies  except  those  near  dc.  This  results  in  Fourier  domain  noise  which  is  wide  sense 
stationary.  Then,  tty  substituting  Eqs  ^6)  and  (7)  into  Eqs.(4)  and  (S)  with  this  sinqrlification,  it  follow  that 


var{0.(u)}  =  JJ[W,(^)W,(C)R,(^-C)+Wi(^)Wi(QRi(^-C)]d^C  (8) 

•• 

var{0.i(u)}  =  JJ[W,(W(C)Ri(^-C)+Wi(§)Wi(C)R,(^-C)]d^dC  (9) 


There  are  several  interesting  atytrqrtotic  prc^rties  that  Eqs.(8)  and  (9)  exhibit.  The  first  is  that,  as  the 
imaginaty  part  of  the  wirulow  jqiproachK  zero,  tlw  variance  reduction  in  the  real  (imaginary)  part  comes  just  fiom 
averaging  the  real  (imaginary)  parts,  and  thus  there  is  no  crosstalk  between  the  real  and  imaginary  components. 
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Two  other  asymptotic  properties  can  be  seen  much  more  easily  by  rewriting  Eqs.(8)  and  (9).  Using  the 
otmvolution-multiplication  relationship  between  the  Fourier  and  inverse  Fourier  domains,  it  can  be  easily  shown 
that 


M  •• 

var{0„(u)}=  |wJ(xK(x)dx+  Jw2(x)i;(x)dx 

«•  «• 

var{0^(u)}=  Jw^(x)i;(x)dx+ Jw^(x)i;(x)dx 


(10a) 


(10b) 


where  Wq(x)  [=(w(x)+w(-x))/2]  is  the  even  part  of  w(x),  Wq(x)  [=(w(x)-w(-x))/2]  is  the  odd  part  of  w(x),  rj(x)  is  the 
inverse  Fourier  transform  of  Rf(u),  and  ri(x)  is  the  inverse  Fourier  transform  of  Ri(u).  Furthermore,  it  will  prove 
#  useful  to  rewrite  Eq.(lO)  in  an  alternate  form.  Let 


w,(x)  =  w,(x)+-j[w,(x)+w_,(x)] 
Wo  (x)  =  y  [w,  (X)-  w_,  (x)] 


(11) 


where  w^fx)  is  the  symmetric  part  of  w(x),  w^Cx)  [=w(x)-W3(x)]  is  the  asymmetric  part  of  w(x),  and 
-  Wgf-x).  It  is  also  ea;^  to  show  that 

We(x)=w,(x)+2~"[w,(x)+w_(x)] 
wS(x)= 2"“  w,(x)+(-2)-“  w..(x) 

because  the  siqiport  functions  w^,  w^,  and  w.^  have  no  intersection.  Then,  by  substituting  Eq.(12)  into  Eq.(lO)  and 
using  the  that  rj(x)  and  r^x)  ate  even  functions,  it  follows  that 


var{0,(u)}  =  Jii(x)dx  +  j  J[i;(x)+i;(x)]dx 


(13a) 


w,(x) 


w,(*) 


var{0«(«)}  =  J«i(x)<ix  +  -j  J[i;(x)+ii(x)]dx 


(13b) 


w,(x) 


w,(x) 


Notice  that  the  variances  of  the  real  and  imaginaiy  parts  are  now  expressed  in  terms  of  the  noises  in  the  symmetric 
and  asymmetric  regions  of  the  support  function.  This  will  be  useful  in  the  next  section  where  image  domain  noise 
leductimi  is  discussed. 

Consider  now  the  case  when  the  support  becomes  very  large  and  the  Fourier  domain  noise  is  not  white 
noise.  For  sinq)licity,  assume  that  the  siq^rt  constraint  is  centered  on  the  origin  and  expanded  equally  in  aU 
directions  (this  does  lutt  inq)ly  that  the  siq^rt  constraint  is  symm^c,  however).  Then,  as  the  siqjport  becon^s 
arbitTarily  large,  the  int^ral  over  w^fx)  will  go  to  zero,  w^fx)  will  be  large  enough  so  that  r^fx)  ami  r|(x)  will  be 
essentially  nonzero  outside  of  Ws(x),  and  then  Eq.(13)  becomes 


L 


var{0„(u)}-  Jii(x)dx  =  R,(0) 


var 


{0^(u)}-  Ji;(x)dx  =  R,(0) 


(14a) 


(14b) 


Thus,  when  the  siqiport  constraint  becomes  atbitrarily  lar^,  no  improvement  is  seen  in  the  variance  of  O^fu)  for 
ncmwhite  noise.  However,  if  the  Fourier  domain  noise  is  truly  white,  then  si^)port  constraints  will  always  result  in 
variance  reduction  regardless  of  the  size  of  the  support  constraint 

The  third,  and  final,  a^miptotic  prc^rty  occurs  when  the  suiqwTt  constraint  becomes  atbitrarily  small  and 
the  Fourier  domain  noise  is  allowed  to  haw  any  degree  of  correlation.  Again  assume  that  the  siq^rt  constraint  is 
centered  on  the  origin.  Then,  as  the  su^iort  constraint  gets  very  small,  eventually  r^fx)  and  q(x)  are 

x>ximately  constant  and  equal  to  r^fO)  and  ri(0),  respectively,  in  the  sui^rt  region.  Then  Eq.(13)  becomes 

var{0„(u)}  -  1^(0)  |dx  +  ^[ii(0)+ii(0)]  Jdx  (15a) 

w,(x)  w,(x) 


var{0^(u)}  -  ii(0)  Jdx  +  •j[ii(0)+i;(0)]  Jdx  (15b) 

w,(x)  w,(x) 


and  so  the  variances  iqjproach  zero  as  the  siq^rt  area  ai^roaches  zero.  From  Eqs.(10H15),  it  can  be  seen  that 
one  application  of  siqiport  constraints  always  results  in  some  degree  of  variance  reduction  in  the  measured  Fourier 
q)ectra,  and  under  tiK  right  ocmditions  can  drive  the  variances  arbitrarily  close  to  zero. 

3  Image  Domain  Varianoe  Reduction 

All  of  the  results  derived  in  the  previous  section  are  theoretical  predictions  for  variance  reductions  in 
Fourier  qiectra  resulting  fix>m  a  single  rqrplication  of  support  constraints  in  the  image  domain.  However,  it  is 
necessary  to  lode  at  what  hrqrpens  in  the  image  domain  since  the  primary  goal  of  using  siqrport  constraints  or  ar^r 
other  ad^onal  information  is  to  improve  the  quality  of  the  image  inside  the  support  constraint.  Because  of  the 
invertibiiity  of  the  Fourier  transform,  all  the  Fourier  domain  variance  reductions  discussed  in  section  2  are  purely  a 
result  of  zeroing  out  noise  in  the  image  domain  outside  of  the  known  siqrport  These  variance  reductions  do  not 
irrqnove  the  quality  of  the  image  inside  the  support  constraints  and,  as  such,  do  not  achieve  any  image  quality 
irrqnovement  since  it  was  alreacty  known  that  the  image  was  zero  outside  the  siq)port.  Therefore,  a  question 
nahtrally  arises;  are  there  any  circumstances  in  which  suiqrort  constraints  can  improve  image  quality  inside  the 
siqrport  constraint?  The  answer  is  yes,  and  this  section  contains  derivations  which  will  specify  what  conditions  are 
necessary  for  this  to  occur.  The  first  observation  to  be  made  is  that,  if  no  change  in  made  in  Ogfu)  prior  to  inverse 
Fourier  transforming,  then  reapplying  the  siqrport  constraint  in  the  image  domain  is  entirely  redun^t  and  no 
firrther  variance  reduction  will  occur  in  the  Fourier  domain.  Also,  no  change  in  image  quality  inside  the  siqqxrrt 
constraint  will  occur.  The  question  then  arises,  what  would  motivate  changes  in  O^fu)  prior  to  irtverse  Fourier 
transforming? 

To  analyze  this  question  in  more  dqrth,  it  is  irrqrortant  to  realize  what  information  is  available  in  the 
Fourier  domain.  There  exists  measured  Fourier  data  and  also  sanqrle  variances  which  provide  a  means  to 
determine  the  quality  d  the  measured  Fourier  data.  Clearly,  if  Ity  ajqrlying  siqqrort  constraints,  the  variance  of 
O^n)  for  all  spatial  fiequencies  is  smaller  than  the  variance  of  the  measured  Fcnirier  data,  then  the  measured  data 
shnild  not  be  used  to  finoe  a  change  in  Ogfu),  and  thus  the  an>lication  of  sui^rt  constraints  cannot  be  used  to 
reduce  the  image  domain  noise  inside  the  siqrpmt  constraint.  Conversely,  if  ^  flying  siqrport  constraints,  the 
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variance  of  OgCu)  for  some  ^tial  frequencies  is  larger  than  the  variance  of  the  measured  Fourier  data,  it  would 
make  sense  to  replace  those  components  of  O^fu)  with  the  measured  Fourier  data  conqwnents.  Only  in  this  case 
would  it  be  possible  to  lower  the  noise  levels  inside  the  support  constraint.  Therefore,  the  next  question  is,  when 
would  siq)port  constraints  increase  the  variance  of  O^fu)  for  some  spatial  frequencies?  To  answer  this  question,  it 
is  first  necessary  to  determine  under  what  conditions  support  constraints  do  not  increase  the  variances  of  Ojfu) 
beyond  the  variances  of  O^fu)  for  any  ^tial  frequency. 

First,  assume  that  the  window  frmction  is  symmetric  so  that  there  is  no  imaginary  part  to  W(u).  Then 
Wgfx)  is  zero  and  Eq.(13)  becomes 


var{0„(u)}=  Jii(x)dx 

w,(x) 

var{0^(u)}=  Jii(x)dx 

w,(x) 


(16a) 


(16b) 


Because  r^fx)  and  rj(x)  are  noimegative  functions,  restricting  the  integration  from  all  x  to  w^fx)  will  never  cause 
the  variances  to  increase.  Therefore,  it  is  necessary  to  have  an  imaginary  conqwnent  to  W(u)  in  order  to  have  the 
possibility  of  increasing  some  variances  of  O^fu)  beyond  those  of  Og(u).  This  is  equivalent  to  saying  that  the 
siqrport  function  must  have  some  asymmetry.  However,  the  conclusion  that  the  support  constraint  must  have  some 
a^mmetiy  is  a  result  of  the  noise  being  wide  sense  stationary.  For  nonstationaiy  noise,  this  conclusion  is  not 
necessarily  valid. 

The  next  case  in  which  the  variances  of  O^fu)  will  always  be  less  than  or  equal  to  the  variances  of  Og(u)  is 
when  the  noises  corrupting  the  real  and  imaginary  parts  of  Og(u)  are  identically  distibuted.  In  this  case,  Eq.(13) 
becomes 


var{0,(u)}=  Ji^(x)dx=var{0,j(u)} 

w(x) 


(17) 


It  is  clear  that  the  variances  of  the  real  and  imaginary  parts  are  no  greater  than  the  variances  of  the  measured  data, 
so  again  there  will  be  no  reason  to  modify  O^fu)  due  to  increased  variances  and  thus  the  applied  siq^rt 
constraints  will  have  no  effect  on  the  image  inside  the  siqq;x>rt  constraint.  However,  this  case  does  ideate  under 
what  conditions  there  might  be  a  reason  to  modify  spectral  points  of  O^lu)  because  they  have  higher  variances  than 
Ogfu).  That  is,  Eq.(13)  indicates  that  the  tqqrlication  of  suiqrort  constraints  causes  coupling  of  the  noises  between 
the  real  and  imaginary  parts  of  *iiie  spectrum  which  is  due  to  the  noise  in  the  asymmetric  portions  of  the  siqrport 
constraint.  If  the  noises  ate  sufi^cicntly  different  in  magnitude,  then  the  plication  of  an  asymmetric  sui^rt 
cmistraint  will  decrease  the  varuuce  of  the  imaginary  part  of  OgCa)  (the  r^  part  of  0^(0))  but  increase  the 
variance  of  the  teal  part  of  Oglu)  (the  imaginaty  part  of  O^u))  beyond  that  of  the  measurements.  Therefore,  it 
iq;ipears  that  the  only  time  sui^rt  constraints  can  be  used  to  ittqrrove  image  quality  inside  the  support  constraint  is 
when  either  the  real  or  imaginary  corrqxment  has  a  suffimently  lower  noise  variance  than  the  other  and  the  su{q)ort 
constraint  is  not  symmetric. 

To  pursue  this  further,  assume  that  the  real  part  of  Ogfu)  is  less  noi^  that  the  imaginary  part.  Because 
both  parts  of  Eq.(13)  have  the  same  form,  these  results  will  also  apply  to  the  case  of  the  imaginary  part  being  less 
n(^  than  the  real  merely  by  interchanging  the  real  and  imaginary  covariances.  Therefore,  it  m^es  sense  to 
em|doy  an  iterative  algorithm  which  replaces  the  siq^rt  constrained  teal  part  of  the  Fourier  transform  with  the 
real  part  of  the  measured  Fourier  data  on  each  iteration  while  leaving  the  imaginary  corrqxment  unchanged.  Thus, 
the  ^gorithm  is  as  fdlows:  (1)  inverse  Fourier  transform  O^fu),  (2)  ^ly  support  constraints,  (3)  Fourier 
transfinrm,  (4)  rqrlace  the  real  part  of  the  Fourier  estimate  with  the  measu^  data,  but  keq)  the  imaginary 
cranpements  unchanged,  (3)  go  back  to  step  1  and  repeat  until  the  noise  is  minimized  inside  the  suiqxrrt  constraint. 

Now  it  will  be  shown  that,  using  this  algorithm,  that  both  the  real  and  imaginary  components  converge 
and  what  they  converge  to.  First  consider  the  imaginary  part  of  the  Fourier  transform:  after  m  iterations  of  the 
algorithin,  the  imaginary  component  will  be  given  by 


(18) 


0s.(m)(“)  =  ^{wr(x)^'[0,i(u)]}  -j^<^{w^(x)W„(X>?^  '[0«r(“)]} 

kaO 


where  ^ and  denote  the  Fourier  and  inverse  Fourier  transform  operation,  req)ectively.  This  result  can  be 

derived  repeated  iq)plication  of  Eq.(3).  Using  Eq.(18)  and  following  the  methods  used  to  derive  Eq.(13),  it  can 

be  shown  that  the  variance  of  Ogj^ni)  S>ven  by 

«• 

'^Osi(m)(“)}  =  J[ws(x)  +  2"^(w,(x)  +  w_,(x))]i;  (x)dx 


j  •j(w,(x)+w_,(x))^rw,(x)+^^(w,(x)+w_,(x))li^(x)dx 

—  ^  k=ol-  2  -I 

J  ■j(w,(x)+w_,(x))^  rw,(x)+^--"-^(w,(x)+w_,(x))1i^(x)dx 

-o>  k*m  L  -* 


=  .  j20-.,,x>.x4 


w,(x)  w,(x) 


21  ^^2-^  kti  2-^ 


Jw.(x) 


(19) 


where,  in  this  equation  and  all  following  equations,  the  summation  terms  are  zero  if  the  iqtper  limit  is  less  than  the 
lower  limit.  Now,  in  the  limit  as  m-^,  the  first  summation  ajqtroaches  four,  the  second  a^roaches  zero,  the 
second  integral  goes  to  zero,  and  it  follows  that 


var{o,i(,)(u)}=  Jii(x)dx  +  2  Ji^(x)dx 


(20) 


w,(x) 


w,(x) 


In  a  similar  way,  it  can  be  shown  that,  after  m  iterations  of  the  algorithm,  the  real  part  of  the  Fourier 
transform  is  given  by 


0»(m)(»)  =  ^{we(x)?^  '[0„(u)]}+j  j{w„(x)wr‘(X^’[Oei(u)]}  +  w.^x)w2(x)J‘‘[0„(u)]}(21) 

k=0 

and  the  variance  is  given  by 

var{o^„)(u)}  =  Ji^(x)dx  +  J2^‘~^^ii(x)dx 


w,(x) 


w,(x) 


1  ^'1  l^"k+l  1^2m-3-kl  f 


ksm-l 


Jw,(x) 


(22) 
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In  the  limit  as  the  first  summation  approaches  oiffi,  the  second  ai^roaches  one  half,  the  third  approaches 
zero,  the  second  integral  goes  to  zero,  and  it  follows  that 


var{0„(.)(u)}  =  Jii(x)dx  +  2  Ji^(x)dx  (23) 

W,<x)  w,(x) 

It  is  intmesting  to  note  that  Eq.(22)  indicates  that  the  variance  of  the  real  part  of  the  support  constrained  Fourier 
^KCtium  changes  even  though,  on  each  iteration,  the  measured  data  replaces  the  siq^rt  constrained  real  part. 
This  is  due  to  coupling  between  the  real  and  imaginaiy  parts  enforced  1^  the  sui^rt  constraint. 

Notice  in  the  previous  equations  that  the  changes  in  the  variances  of  the  real  and  imaginaiy  su^Mit 
constrained  components  are  due  to  changes  in  the  noise  in  the  asymmetric  portions  of  the  sun>ort  constraint. 
Furthermore,  because  the  goal  of  aiqilying  su|^rt  constraints  is  to  minimize  noise  in  the  image,  not  the  Fourier 
qiectrum,  it  is  necessary  to  determine  how  tlw  noise  variances  inside  the  siqiport  constraint  in  the  image  domain 
change  as  a  function  of  the  number  of  algorithm  iterations.  To  this  end,  let  n^ifx)  be  the  noise  in  the  image 
domain  after  m  iterations  of  the  algorithm  which  results  from  tlw  inverse  Fourier  transform  of  (Nf(ni^,Ni^gip. 
Then  it  follows  that  <ng|(x)>  =  0  and  that 


«•  M 

< n„(x,)n„(xj)>  =  <  J[n,(„)(u,)+ jNi(„j(u,)]ej^*‘‘“‘du,  jNi(„j(u2)]e'^’“»“»du2 


=  J  J[<NK«)(Ui)N^„)(U2)>-»-<Ni(„)(u,)Ni(„)(u2)>-j<N^„)(u,)N^„)(U2)> 


+j<  Ni(„)(«i)NK„)(U2)>p*‘'“'e-^*‘«“'dU2du,  (24) 

After  making  a  change  of  variables  fiom  u  j  to  Au  =  (U]-U2),  it  follows  that 


< n„(x,)n„(x2)>  =  J  J[R^„)(Au)+Ri(„)(Au)+jRi^„)(Au)-jRri(„)(Au)]ej^”‘‘^ej^’^*>"’‘>^>d(Au)du2 


=  {R.(in)(«)  +  Ri(m)(«)  +  jRiKm)(«)  "  JRri(m)(»)}5(Xl  "  *2  )  (25) 

where  is  the  autocovariance  of  the  real  part  of  the  Fourier  domain  noise,  (^(m)  ^  autocovariance  of  the 

imaginaiy  part  of  the  Fourier  domain  noise,  a^  m)  ^  ^(m)  ^  ^  cross-covariances  of  the  imaginaiy  and 

the  real  and  the  real  and  the  imaginaiy  parts  of  the  Fmirier  domain  noise,  req)ectively,  after  m  iterations.  Rr(in) 
and  Ri(in)  can  be  obtained  1^  generalizing  Eqs.(19)  and  (22),  and  Rir(in)  and  Rn(in)  can  be  derived  fiom  Eqs.(18) 
and  (21).  Substituting  these  expressions  into  Eq.(2S)  gives 


0^(X)  ■  ^  '{RKm)(u)  +  Ri(m)(“)  +  jRir(m)(u)-jRri{n.)(“)} 


=  [ii(x)  +  i-(x)]w,(x)  +  2(^~^^i;(x)w.(x)  + 


I, 

IfO  ^ 


k  +  1 


2m-2 


ksm 


2m-l-k 


w,(x)i,(x) 


+ 


i4.vJ- 

2  2'‘  ^  8  2*' 
^  k»l  ®  kaiO 


2m -4 


2m-3-k 


k=m-l 


w,(x)ii(x) 


(26) 


and,  as  m-4oo, 

oi(x)=  [i;(x)  +  i-(x)]w,(x)  +  4^(x)w,(x)  (27) 

Eq.(27)  implies  that  the  more  asymmetric  the  object  and  the  less  noi^  the  real  part  of  the  measured 
spectra,  the  lower  the  variance  of  the  image  domain  noise  inside  the  support  constraint.  If  the  support  of  the  object 
is  completely  asymmetric,  then  the  noise  in  the  image  is  completely  determined  1^  the  noise  in  tlK  real  part  of  the 
Fourier  qtectrum.  Thus  it  could  be  construed  that,  if  the  object  is  moved  off  center  sufficiently  &r,  then  suiqwrt 
constraints  can  be  used  to  completely  remove  all  the  noise  ^m  the  image  if  the  real  portion  of  tlte  Fourier  data 
was  noise  free.  This  is  true  ui^r  the  assumptions  of  the  noise  model  used  in  the  theoretical  derivation.  However, 
if  the  object  is  itot  centered  in  the  image  plaite,  the  assumption  of  urteorrelated  real  and  imaginary  noises  is  no 
longer  valid  due  to  the  induced  tilt 

The  noise  in  the  image  domain  within  the  support  constraint  is  given  by  Eq.(26),  and  it  is  clear  that  the 
nc^  within  the  synunetric  portion  of  the  siqqwrt  constraint  is  unaffectedhy  repeat^  support  constraint 
^licadoits.  However,  the  noise  in  the  asymmetric  portion  is  a  fimction  of  the  number  of  support  ai^lications.  It 
is  not  clear  from  Eq.(26)  the  nuihber  of  iterations  needed  to  minimize  the  noise  inside  the  suf^rt  constraint. 
Therefore,  to  detennine  the  number  of  iterations  to  reach  tlK  minimum  noise  level,  it  is  necessary  to  calculate  the 
difference  in  the  variances  between  the  m  and  the  (m-1)  iteration  and  determine  when  the  difference  stops  being 
negative  and  becomes  positive.  After  some  algdrraic  manipulation,  the  desired  difference  is  given  by 


<Jm(x)-oi-i(x)=^ 


m-4 


m-5 


tV  > +y  ‘ 


k«0  y 


E"+20 


ii(x)-12ri(x)[w,(x) 


;  m^4 


=  -^[I3^(x)-  3i;(x)]w,(x) 
io 


;  in  =  3 


=  •i[5i^(x)-3ii(x)]w.(x) 


;  m  =  2 


(28) 


Notice  that  the  only  region  in  the  image  domain  where  variatKes  are  changing  as  a  result  of  the  algorithm  is  in  the 

asymmetric  region  of  the  support  constraint  Also  notice  that  the  term  in  Eq.(28)  which  causes  o^(x)  -  o^_i(x) 
to  be  negative,  and  thus  decrease  the  error  in  the  support  constraint  from  the  previous  step,  is  ri(x)  multiplied  by  a 
ocmstant  frctor.  However,  the  positive  term  consists  of  r{(x)  multiplied  by  an  increasing  function  of  m  which 

sqiproaches  <»  as  m-^,  and  thus  -  o^_i(x)  becomes  positive  for  some  finite  value  of  m  as  long  as  rf(x)>0. 
This  means  that  the  number  of  iterations  needed  to  achieve  the  minimum  amount  of  noise  insitfe  the  support 
constraint  is  a  finite  number  (for  rj(x)>0)  and  increasing  the  iterations  beyond  this  level  wiU  increase  tte  noise.  If 
tj(xy=0,  then  the  noise  levels  inside  the  siqqrort  constraint  decrease  for  every  value  of  m  and  the  minimum  noise 
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levd  occurs  for  m=oo.  If  the  ratio  r^x)/ri(x)  is  large  enough,  then  o^(x)  -  o^_,  (x)  will  always  be  positive  for 
tone  than  one  plication  of  siqjpoit  constraints  and  there  is  no  possibility  of  reducing  the  error  in  the  image 
domain  inside  tte  su^iort  constraint.  The  tq^r  bound  for  rj(x>/rj(x)  that  allows  a  decrease  in  the  image  (krmain 

variance  via  repeated  applications  of  siqrport  constraints  can  be  determined  by  setting  o^(x)  -  a^_,(x)  equal  to 
zero  for  m-2  and  solving  for  rf(x)/ri(x),  which  results  in 


^(x)  _  3 
ii(x)  “  5 


(29) 


Thus,  if  the  noise  properties  are  known,  it  can  be  determined  a  priori  whether  or  not  support  constraints  can  be 
used  to  lower  the  amount  of  noise  inside  the  suiqx)rt  constraint. 

The  results  contained  in  Eqs.(26H29)  reflect  the  variance  properties  of  the  noise  in  the  image  (fomain  at 
each  point.  However,  in  general  rj<x)  and  rjCx)  will  have  different  fluu^onal  forms,  and  thus  the  number  of 
iterations  needed  to  minimize  the  variance  in  the  image  domain  will  be  a  function  of  x.  Therefore,  it  is  necessary 
to  calculate  the  integral  of  the  variance  of  the  noise  over  all  x  to  determine  the  number  of  iterations  required  to 
minimize  the  total  noise  in  the  image.  This  is  easily  accomplished  by  replacing  all  the  functions  of  x  in  Eqs.(26)- 
(29)  with  their  integrals  over  x.  In  particular,  it  is  easy  to  show  that  Eq.(29)  becomes 


(30) 


ndiich  determines  the  dividing  line  between  siqrport  constraints  being  able  to  reduce  noise  inside  the  siqiport 
constraint  or  not  relative  to  the  total  noise  in  the  image  domain. 

All  of  the  above  results  occur  when  the  teal  part  of  the  siq^rt  constrained  Fourier  q)ectrum  is  kqjt  equal 
to  the  measured  data  while  letting  the  imaginary  become  what  the  siqrport  constraints  require.  An  obvious 
ahemative  to  this  algorithm  is  to  constrain  both  the  teal  and  imaginaty  parts  of  the  measured  Fourier  data  at  each 
iteration  to  stay  within  some  region  about  its  mean  value,  typically  detemined  fiom  the  variances  of  the  noises. 
This  has  been  the  suggested  qqraoach  to  use  when  employing  a  convex  projections  approach  to  include  additional 
infimnadon^’^.  However,  it  will  be  shown  via  computer  simulation  in  the  next  section  that  this  modification  to  the 
algmithm  usually  results  in  more  ncnse  than  the  original  algorithm. 

A  nnmpirter  Simiilfllion  Rwailts 

The  first  step  undertaken  in  the  corrqxiter  simulation  effort  was  to  validate  the  theoretical  (ferivations  in 
the  previous  section.  To  this  end,  an  off-axis  point  source  was  used  as  the  uncorrupted  object  It  was  then  Fourier 
transformed  and  zero  mean  gaussian  conqrlex  white  noise  with  real  and  imaginary  variances  Of^  and  a^, 
reqrectively,  was  added  for  various  ratios.  This  results  in  ^(x)  =  Oj^  and  r^x)  =  Of^.  Because  the  results 

ate  completely  symmetric  for  >  Oj^,  results  for  only  are  shown.  In  action,  because  the  noise  is 

ddta^orrelated,  the  terms  in  Eq.(7)  which  ate  functions  of  U1-H12  are  zero  except  at  dc.  All  simulations  used  the 
mean  of  the  measured  Fourier  d^  and  the  true  (not  estimated)  variance  of  the  noise  to  determine  the  Fourier 
dmnain  constraints. 

Fmeach  dataset,  the  algorithm  described  in  the  previous  section  was  used  to  ^ly  siq^rt  constraints 
until  the  algmithm  omverged.  The  siqiport  constraint  ^lied  was  a  triangle  which  partially  overly  the  origin 
so  that  the  area  of  the  triangle  which  is  asymrtKtric  d)out  the  (nigin  is  83%  of  the  total  triangle  area.  Sample 
variances  were  calculated  at  each  qratial  fiequency  and  at  each  point  inside  the  siq^rt  and  averaged  at  each 
itoation  to  provide  sarrqrle  variances  of  the  siqiport  constrained  Fourier  qjectrum  and  of  the  image  before  the  real 
port  was  rq^aoed  with  the  initial  data.  Fig.  1  shows  the  theoretical  predictions  and  simulation  results  for  the  real 
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part  of  the  siqiport  constrained  Fourier  spectra,  Fig.2  shows  the  same  r^ts  for  the  imaginary  part  of  the  siqipoit 
constrained  Fourier  spectra,  and  Fig.3  shows  the  total  variance  inside  the  asymmetric  part  of  tte  siqrport 
constraint.  The  symmetric  part  is  not  shown  because,  as  predicted  by  Eq.(28),  it  remains  unchanged  during  the 
repeated  rqiplication  of  siq>port  constraints.  Notice  the  close  match  between  simulation  and  theory.  It  can  be  seen 
in  Fig.3  that  there  is  no  change  in  the  variance  between  the  first  and  second  iteration  for  Of^/Oi^=0.6,  and  then  the 
noise  increases.  This  r^ult  confirms  the  theoretical  prediction  given  by  Eq.(29). 

These  results  were  obtained  by  constraining  the  real  part  of  the  sr^qwit  constrained  Fourier  data  to  match 
the  measured  Fourier  data  at  each  iteration,  but  the  imaginary  part  was  left  unconstrained.  Next,  these  results  were 
compared  to  the  results  obtained  requiring  both  the  real  a^  imaginary  parts  of  the  siq^rt  constrained  Fourier 
data  to  remain  within  a  qiecified  region  about  the  measured  Fourier  data.  Prior  to  ittq)lementing  this  modification 
to  the  algorithm,  the  Fourier  data  was  smoothed  using  the  results  of  Eq.(16);  that  is,  Eq.(16)  predicts  that  the 
result  of  qrplying  a  symmetric  support  constraint  will  be  a  decrease  in  the  variance  of  both  the  real  and  imaginary 
parts  of  the  Fourier  spectrum.  Of  course,  this  does  not  decrease  the  noise  inside  the  suf^rt  constraint  in  the  image 
domain,  but  it  can  be  used  to  decrease  the  noise  in  the  Fourier  data  before  using  it  as  a  constraint.  For  this  part  of 
the  computer  simulation,  the  smallest  symmetric  support  constraint  that  included  the  »mial  sujqwrt  constraint  was 
calculated,  the  initial  data  was  smoothed,  and  a  reduced  variance  was  calculated  using  Eq.(16).  This  smoothed 
data  with  the  refined  variance  estimate  was  then  used  for  the  initial  data  in  the  algorithm.  Fig.4  conq>ares  the 
results  fix>m  the  original  algorithm  and  the  modified  algorithm  for  tl^  case  where  Of^/Oj^l  and  where  the  Fourier 
domain  constraint  was  that  the  support  constrained  Fourier  spectrum  was  required  to  stay  with  ±lo  of  the 
smoothed  data.  Bounds  of  ±2o  and  ±3o  were  also  used,  but  the  results  were  very  similar  to  the  ±lo  case.  The 
result  of  running  this  modified  algorithm  until  it  converged  was  increased  noise  both  in  the  ^mmetric  and 
asymmetric  parts  of  the  siqqwrt  constraint  As  predicted  by  Eq.(29),  noise  reduction  is  not  possible  for  a  noise  ratio 
at Notice  that,  for  m>2,  the  modified  algorithm  resulted  in  lower  noise  levels  inside  the  sunwrt 
constraint,  but  it  still  increased  the  noise  inside  tte  support  constraint. 

The  results  from  using  the  modified  algorithin  for  the  case  of  Of^/Oi^=0.6  (which  is  the  borderline  case 
for  noise  reduction  using  siqrport  constraints)  are  shown  in  Fig.S.  In  this  case,  the  modified  algorithm  resulted  in 
increased  noise  inside  the  support  constraint  if  the  algorithm  was  run  until  convergence  is  achieved.  If,  however, 
the  algorithm  had  been  stq^  at  the  second  iteration,  the  modified  algorithm  resulted  in  slightly  less  noise  than 
the  original  alg(»ithm.  Oiice  again,  the  modified  algorithm  resulted  in  increased  noise  in  the  symmetric  part  of  the 
siq)port  constraint 

The  third  case  to  be  locdced  at  is  for  The  results  can  be  seen  in  Fig.6.  Notice  that  the 

original  algorithm  results  in  lower  noise  levels  in  the  image  as  conq>ared  to  the  results  from  using  the  modified 
algorithm.  It  is  clear  fiom  locridng  at  these  three  examples  that,  if  the  noise  statistics  are  known,  it  can  be  decided 
a  pritni  whether  support  constraints  will  increase  or  deoease  the  noise  inside  the  su^wri  constraint.  If  the  noise 
levels  will  decrease,  then  the  original  algorithm  produces  the  best  or  comparable  re^ts  as  compared  to  the 
modified  algorithm  as  long  as  the  iteration  numter  for  which  the  minimum  is  obtained  is  calculated  and  the 
algorithm  is  stqiped  at  that  point  If  the  noise  statistics  are  not  known,  the  modified  algorithm  using  the  smoothed 
data  is  the  best  compromise  to  using  support  constraints  if  one  is  unsure  whether  support  constraints  will  result  in 
increased  or  decrea^  noise  in  the  image.  Although  the  modified  algorithm  does  not  achieve  the  minimum  noise 
in  the  image,  in  general,  excessive  noise  in  the  image  is  also  avoided. 

As  a  final  exanqrle,  a  satellite  model  was  used  as  the  true  object.  Fig.7  shows  the  model  used,  and  Fig.8 
shows  the  suiqwrt  of  the  satellite.  The  white  region  of  the  support  is  the  symmetric  region,  and  the  gray  region  is 
the  asymmetric  region.  Zero  mean  white  gaussian  noise  with  a  variance  equal  to  10^  times  the  dc  value  of  the 
image  was  added  to  the  imaginary  part  of  the  satellite's  Fourier  transform,  but  the  real  part  was  kqrt  noise-firee. 
Frcnn  Eq.(29)  it  follows  then  that  the  minimum  noise  level  is  reached  only  at  infinity.  The  noi^  image  is  shown  in 
Fig.9,  where  the  satellite  image  is  completely  masked  by  the  noise.  The  original  algorithm  was  run  for  20 
iterations,  reidacing  the  noisy  real  part  of  the  Fourier  transform  of  the  support  constrained  image  with  the  noise- 
fiee  data  each  iteratioa  The  resulting  image  is  shown  in  Fig.  10.  Notice,  by  conqraring  Fig.8  with  Fig.  10  that  the 
noise  in  the  symmetric  part  of  the  image  remained  uiKhanged,  while  the  asymmetric  part  of  the  image  is  now 
essentially  noise-firee. 
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y  Concittaais 

TheoTetical  results  have  been  derived  which  predict  the  effects  of  repeated  ai^lications  of  suj^it 
omstiaiiits  in  both  the  image  and  Fourier  domain  for  the  case  of  wide  sense  stationary  Fourier  domain  noise. 

These  results  assume  that,  for  each  iteration  of  the  algorithm,  the  initially  less  noisy  part  of  the  Fourier  qrectrum 
(real  ot  imaginary)  replaces  the  (real  or  imaginary)  part  of  the  su{^rt  constrained  Fourier  spectrum.  It  was  shown 
that  this  algorithm  converges,  but  the  point  of  minimum  noise  is  achieved  for  a  finite  number  of  iterations  if  both 
the  real  and  the  imaginafy  parts  of  the  measured  Fourier  data  are  noisy,  and  iterating  beyond  that  point  increases 
the  noise  in  the  image.  It  was  also  shown  that  constraining  the  siq)port  constrained  Fourier  data  to  remain  with 
^iecified  bounds  of  the  measured  data  results  in  the  conq)arable  or  higher  noise  levels  in  the  final  image  than  the 
miginal  algorithm  when  the  algorithm  is  stt^jped  at  the  point  of  minimum  noise.  This  is  due  to  the  fact  that 
measured  data  will  always  have  data  points  outside  the  ±lo  (or  2a,  3o,  etc.)  regions  centered  on  the  true  values. 
Thus,  requiring  the  siqipott  constrained  Fourier  data  to  stay  close  to  the  measured  data  can  resuh  in  mitigating  the 
variance  reduction  acldevable  by  support  constraints.  Because  the  noise  is  assumed  to  be  wide  sense  stationary,  the 
siqiport  constraint  is  required  to  have  asymmetry  and  the  noises  comqrting  the  real  and  imaginaty  parts  the 
measured  Fourier  data  must  be  sufficiently  dissimilar  for  noise  reduction  inside  the  siqiport  constraint  to  be 
achieved. 

A  result  firom  this  woric  is  that  enforcing  siq^rt  constraints  can  result  in  higher  noise  levels  inside 
the  siqiport  constraint  than  before  the  constraints  were  aiqilied  if  the  algorithm  is  continued  until  convergence  is 
obtained.  Another  key  result  is  that  the  point  of  minimum  itoise  in  the  image  domain  is  always  reached  before 
convergence  (for  noi^  Fourier  data).  T^  ^qiears  to  be  a  fimdamental  pixqierty  of  noisy  data.  As  a  result,  the 
convex  projections  method  should  be  used  with  caution.  This  is  because  the  convex  set  which  results  fiom  keqiing 
the  siqiport  constrained  Fourier  spectrum  within  a  region  rdiout  the  mean  of  the  measured  Fourier  spectrum  does 
not  intersect  the  convex  set  which  results  fiom  tqiplying  a  siqqxirt  constraint  in  the  image  domain,  in  general. 
Although  the  set  in  the  Fourier  domain  can  be  niade  large  enough  to  intersect  the  support  convex  set,  d<^  this 
will  usually  result  in  a  set  so  large  that  there  is  no  change  insicte  the  siqqi^  constraint  resulting  firom  flying 
siqqiort  constraints.  A  better  ^roach  than  this  is  to  use  the  algorithm  proposed  in  this  paper. 
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Fig.  1.  Variance  of  individual  elements  of  the  real  part  of  the  support  constrained  Fourier  spectrum  as  a  function  of 
the  number  of  iterations  for  (a)  -  1,  (b)  =  0.6,  and  (c)  =  0.2.  The  solid  lines  are 

theoretical  predictions  and  the  symbols  represent  simulation  data  points. 


Fig.2.  Variance  of  individual  elements  of  the  imaeinaiy  part  of  the  support  constrained  Fourier  spectrum  as  a 
function  of  the  number  of  iterations  for  (a)  1,  (b)  =  0.6,  and  (c)  =  0.2.  The  solid  lines 

are  theoretical  predictions  and  the  ^mbols  represent  simulation  ^ta  points. 


Number  of  Iterotions 


Fig.4.  Variances  for  ==  1  as  a  function  of  the  iteration  number.  Curves  (a)  and  (b)  are  the  total  variances 

in  the  asynuiKtric  region  of  the  support  constraint  for  the  ori^nal  algorithm  and  the  modified  algorithm, 
respectively.  Curves  (c)  and  (d)  are  the  total  variances  in  the  symmetric  region  of  the  support  constraint  for  the 
modified  algorithm  and  the  original  algorithm,  respectively. 
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Number  of  Iterations 

Fig.5.  Variances  for  =  0.6  as  a  function  of  the  iteration  number.  Curves  (a)  and  (b)  ate  the  total  variances 

in  the  asymmetric  region  of  the  support  constraint  for  the  original  algorithm  and  the  modified  algorithm, 
resp^vcly.  Curves  (c)  and  (d)  are  the  total  variances  in  the  symmetric  region  of  the  support  constraint  for  the 
modified  algorithm  and  the  original  algorithm,  respectively. 


Number  of  Iterotions 

Fig.6.  Variances  for  =  0.2  as  a  function  of  the  iteration  number.  Curves  (a)  and  (b)  are  the  total  variances 

in  the  asymmetric  region  of  the  support  constraint  for  the  original  algorithm  and  the  modified  algorithm, 
reqi^vely.  Curves  (c)  and  (d)  arc  the  total  variances  in  the  symmetric  region  of  the  support  constraint  for  the 
modified  algorithm  and  the  original  algorithm,  respectively. 


Fig.7.  Uncomipted  satellite  image. 


Fig.8.  Support  region  of  satellite  image  in  Fig.7.  The  symmetric  part  of  the  support  is  shown  in  white,  while  the 
asymmetric  part  is  shown  in  gray. 


Fig.9.  Noise  comipted  satellite  image  for  Oj2=10^  times  the  dc  value  of  the  image  and  Oj2=0.0. 


Fig.  10.  Reconstructed  satellite  image  after  20  iterations  of  the  original  algorithm. 
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Abstract 

In  this  papa,  the  role  positivity  pltys  in  error  reduction  in  images  is  analyzed  both  theoretically  and  with  conqiuter 
simulatkms  for  the  case  of  wi^-sense  stationary  Fourier  domain  noise.  It  is  shown  that  positivity  behaves  as  a 
signal-  and  noise^lqiendent  support  constraint.  As  a  result,  the  mechanism  by  which  positivity  results  in  noise 
reduction  in  images  is  Ity  corrd^g  measured  Fourier  qiectra.  Noise  reduction  occurs  in  the  atynunetric  part  of 
the  positivityMnduoed  support  constraint  when  positivity  is  tqjplied  just  as  noise  reduction  occurs  in  the  atymmetric 
part  of  the  true  sum»rt  crmstraint  when  siqiport  is  applied.  In  addition,  the  positivity-induced  siqiport  constraint 
dianges  size,  in  general,  for  each  iteration  of  the  algorithoL 


1.  Introduction 

Noise  reduction  in  images  with  the  use  of  knowledge  in  addition  to  the  measured  data  has  received  much 
attention  over  the  years^*^.  Recently,  a  detailed  analysis  of  how  suiqx>rt  functions  as  a  constraint  to  reduce  noise 
inside  the  siq^rt  constraint  has  been  completed^’^.  It  has  been  shown  that,  for  wide-sense  stationary  Fourier 
Awtuiin  noise,  siqtport  constraints  can  be  used  to  reduce  the  noise  inside  the  stq^rt  constraint  if  the  ratio  of  the 
real  and  imaginary  Fourier  data  variances  is  sufficiently  small  or  large.  It  has  also  been  shown  that  support,  for 
this  type  of  noise,  does  not  result  in  noise  reduction  in  the  ^irunetric  part  of  the  support  constraint,  only  in  the 
asymmetric  part. 

In  this  paper,  the  same  approach  as  in  Ref  5  is  taken  to  analyze  positivity  as  a  constraint  for  Fourier 
domain  wide-se^  stationary  noise.  It  is  shown  that  positivity  acts  as  a  signal-  and  noise-dependent  si^rport 
ccmstraint  Inside  the  asyrrunetric  part  of  the  positivity-induced  su{^rt  constraint,  noise  rechiction  is  possible  just 
as  when  using  support  as  a  constraint.  Inside  the  symmetric  part  of  the  positivity-induced  suiqxrrt  constraint,  no 
nt^  reduction  is  possible  just  as  when  using  suiqrort  as  a  constraint.  In  addition,  noise  reduction  inside  the 
otrject's  siqiport  using  positivity  is  greater  than  when  using  the  true  support  constraint  in  the  high-noise 
environment  The  p^r  is  organized  as  follows;  Section  2  contains  the  theoretical  development.  Section  3 
contains  the  conqMiter  simulation  results,  and  Section  4  contains  the  conclusions. 

2.  Tbcoiy 

Let  o(x)  be  the  unoorrupted  image  and  let  i(x)  be  the  measured  image.  Then  i(x)  is  given  by 

i(x)  =  o(x)+n(x)  (1) 

where  n(x)  is  the  inverse  Fourier  transform  of  zero-mean  wide-sense  stationary  noise  (Nf(u),Ni(u))  whose  second 
moments  satisfy 


{N,(U,)N,(U2))  =  R,(u,-U2)  +  Rr(Ui+U2) 

(Ni(Ui)Ni(u2))  =  Rj(u,  -U2)-Ri(u,  +U2)  (2) 

(Ni(u,)N,(U2))  =  {N,(u,)Ni(U2)>  =  0 


where  the  terms  involving  sums  of  spatial  frequencies  will  be  neglected  since  they  only  have  an  inqract  near  dc. 
This  noise  model  is  sufficiently  gen^  to  accurately  characterize  CCD  read  noise  and  photon  noise.  Assume  also 
that  the  data  was  measured  in  the  Fourier  domain  so  that  there  exists  both  the  measured  data  I(u),  the  Fourier 
transform  of  i(x),  and  its  variance,  var{I(u)},  at  each  frequetuy. 

Next,  an  algorithm  must  be  chosen  which  will  be  used  to  enforce  positivify  as  a  constraint  while  requiring 
I(u)  to  remain  close  to  the  measured  Fourier  data  in  some  sense  in  terms  of  var{I(u)}.  Because  the  noise  in  the 
Fourier  domain  is  wide-sense  stationary,  the  variance  of  Ix^  the  real  and  the  imaginary  parts  of  I(u)  will  be 
independent  of  frequency.  Both  because  ofeaseofanalysis  and  because  it  has  performance  conqtarable  to  or  b^ter 
than  a  standard  convex  projections^'^  algorithm  when  using  siqrport  as  the  image  domain  constraint  for  wide- 
sense  statumary  noise,  the  following  algorithm^  will  be  used.  Starting  in  the  image  domain  and  assuming  that  the 
variance  of  the  real  part  of  I(o)  is  less  than  or  equal  to  the  variance  of  the  imaginary  part  of  I(u),  (1)  zero  out  aU 
n^ative  values  of  i(x),  (2)  Fourier  transform  i(x),  (3)  replace  the  real  part  of  the  positivity-constrained  Fourier 
qrectrum  with  the  teal  part  of  the  measured  data,  (4)  inverse  Fourier  transform,  and  (5)  start  over  with  step  1  as 
I^  as  the  noise  has  not  been  minimized  yet.  In  Ref.S,  it  is  shown  that  the  minimum  noise  achieved  irisi^  the 
support  constraint  occurs  before  the  algorithm  converges.  However,  this  is  not  the  case  for  positivify,  in  general. 

In  stq>  one  of  the  algorithm,  the  locations  in  which  i(x)  is  zeroed  out  form  a  signal-  and  noise-dqrendent 
stqrport  ccmstraint  In  general,  with  each  additional  iteration  of  the  algorithm,  the  signal-dependent  stqrport 
constraint  will  change.  As  a  result,  the  first  step  in  analyzing  the  algorithm's  performance  is  to  determine  how  Uk 
siqiport  changes  on  each  iteration.  Let  wj(x)  be  the  ^qtport  constraint  obtained  during  the  first  iteration  of  the 
algmithm  as  a  result  of  the  zeroes  that  exist  in  i(x)  and  the  zeroes  that  result  from  enforcing  the  positivify 
oonstrainL  Furthermore,  let  i}(x)  be  the  image  at  the  end  of  the  first  iteration,  which  is  given  by 
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*1  (x)  =  -jIUx) + U-x)] + y[w,  (x)i(x)  -  w,  (-x)i(-x)]  (3) 

where  the  first  bradceted  term  is  the  inverse  Fourier  transform  of  the  real  part  of  I(u)  and  the  second  bradceted 
term  is  the  inverse  Fourier  transform  of  the  imaginary  part  of  l}(u),  the  Fourier  transform  of  i}(x).  To  determine 
the  new  signal-dependent  su{qx>rt  constraint  to  be  us^  for  the  second  iteration,  W2(x),  obtaiiKd  by  imposing 
positivity  upon  i}(x),  it  is  us^  to  separate  the  image  domain  into  four  non  overlapping  regions;  (1)  wi(x)=wi(- 
x)=l,  (2)  wj(x)=wj(-x)=0,  (3)  W|(x)^  and  W|(-x)=l,  and  (4)  wj(x)=l  and  W2(-x)=^. 

Region  1  after  one  iteration:  because  wi(x)=wi(-x>=l.  Eq.(3)  becomes 


=  i(x) 


(4) 


Since  wi(x)=l,  i(x)  is  noimegative  and  thus  W2(x)=wj(x)=l.  This  means  that  once  points  in  the  image  domain  are 
in  region  1,  they  stay  there. 

•  Region  2  after  one  iteration:  because  wi(x)=wi(-x)=0.  Eq.(3)  becomes 

i,(x)=i[i(x)+i(-x)]  (5) 

Because  W}(x>=w^(-x)=0,  both  i(x)  and  i(-x)  are  either  zero  or  negative.  Thus  it  follows  that  i^Cx)^  and  thus 
0  W2(x)=wi(x)=0.  As  for  region  1,  once  points  are  in  region  2,  they  never  leave. 

Region  3  after  one  iteration:  because  W|(x)=0  and  W|(-x>=l,  Eq.(3)  becomes 


i,  (x) = ■jfKx) + i(-x)]  — ii(-x) 


=  fi(x) 


(6) 


Since  wj(x)=0,  i(x)^,  and  thus  W2(x)=wi(x)=0.  Furthermore,  once  a  point's  sunwrt  fimction  becomes  zero,  it 
sti^  zero.  However,  region  3  will  change  in  size  since  region  4  changes  in  size,  as  shown  next 

Region  4  after  one  iteration:  because  wi(x)=l  and  wi(-x)=0,  Eq.(3)  becomes 


ij  (X) = -^[Kx) + i(-x)] +-ji(x) 
=  i(x)+-ji(-x) 


(7) 


In  this  region,  i}(x)  could  be  either  positive  or  negative,  dq)ending  upon  the  relative  size  of  i(x)  and  i(-x).  If 
i|(x)>0,  thenw2(x)=wj(x)=l.  If,  however,  i](x)^,  then  W2(x)=0.  Thus  this  point  would  move  from  region  4  into 
r^km  2.  Thus,  it  can  be  seen  that  after  one  iteration,  the  su]qx>rt  size  has  not  increased  in  size  and  probably  has 
decreased  in  size. 


FoUowing  the  same  stq>s  as  above,  it  can  be  shown  that,  after  n  iterations,  iQ(x)  is  given  by 
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‘n  (X)  =  +  i(-x)]  +i[w„(x)i„_,(x)-  w„(-x)i„_,(-x)] 


(8) 


where  in.i(x)  depends  upon  the  region  it  is  in.  In  tuklition  to  finding  iQ(x),  it  is  necessary  to  find  the  sizes  of  the 
regions  and  total  mean  square  error  (MSB)  in  the  regions  to  determine  how  positivity  is  affecting  the  noise 
diaracteristics  of  the  iterated  data. 

Re^l  after  n  iterations:  because  Wq(x>=Wo(-x)»1.  Eq.(8)  becomes 


»n  (X) = |[i(x)+ i(-x)] + j[i(x)-  i(-x)] 
=  i(x) 


(9) 


So,  after  n  iterations,  region  1  remains  unchanged  in  size  atxl  the  image  remains  unchanged.  The  size  of  region  1 
can  be  fiMind  by  nniltiplying  the  area  of  the  image  by  the  joint  probability  that  i(x)>0  and  i(-x)>0,  which  is  given  by 


P{i(x)>0  and  i(-x)>0}  =  P{o(x)+n(x)>0  and  o(-x)+n(-x)>0} 

=  P{n(x)>-o(x)  and  n(-x)>-o(-x)} 

In  addition,  the  mean  square  error  (MSB)  in  the  regitm  is  given  Ity 

MSE^,=  5^[i(x)-o(x)f  =  ]^B{n^(x)jn(x)>-o(x)andn(-x)>-o(-x)} 

ragiaol 


(10) 


(11) 


Ndtkx  that  both  the  size  (tf  region  1  and  the  error  in  regkrn  1  are  unaffected  by  the  ai>pIication  of  positivity  and 
thus  are  indqiendent  of  the  number  of  iteratimis.  This  is  the  same  as  for  support  constraints^. 


Region  2  after  niteratioiis:  because  Wq(x)>Wq(-x>*0,  Bq.(8)  becomes 

in(x)  =  'j[i(x)+i(-x)] 


(12) 


The  dements  in  this  region  that  were  in  this  region  after  oae  iterafimi  are  still  here,  since  positivity  is  not  changing 
the  value  (ffi^fx).  As  discussed  above,  points  fiom  region  4  can  migrate  in  here.  However,  once  the  points  make 
it  in  here,  they  slay  here.  The  size  of  the  region  is  found  by  multiplying  the  area  of  the  image  tty  the  probability  of 
being  in  this  region  ndiidi  is  given  Ity 

P{w„(x)=0  and  w„(-x)=o}  =  P{w(x)=0  and  w(-x)=0} 

+P{points  fix>m  region  4  moving  to  region  2  after  n  iterations} 

=  P{n(x)  S  -o(x)  and  n(-x)  S  -o(-x)} +[P4(0)  -  P4(n)]  (13) 

ndiere  P4^q^  is  the  probability  that  a  point  is  in  region  4  at  the  n^^  iteration.  The  MSB  in  this  region  is  given  by 


MSB^j(„)=  5^o*(x) 

regicn  2(a) 


(14) 


and  dianges,  in  general,  on  each  iteration. 


(15) 


Region  3  after  n  iterations:  because  Wn(x)=0  and  WQ(-x)=l.Eq.(8)  becomes 

‘n(x)  =  y‘(x) 

and  this  region  is  decreasing  in  size  since  region  4  is.  The  probability  that  a  point  is  in  this  region  after  n 
iterations  is  given 


P{wa(x)=0  and  w„(-x)  =  l}  =  P{w(x)  =  0  and  w{-x)  =  l} 

-P{points  ft^om  region  4  moving  to  region  2  after  n  iterations} 

=  P{n(x)<-o(x)  and  n(-x)^-o(-x)}-[P4(o)-P4(n)]  (16) 

and  the  total  MSE  in  this  region  after  n  iterations  is  given  by 

=  5^o^(x) 

region  3(n) 

Region  4  after  n  iterations:  because  Wq(x)=1  and  Wq(-x)=0,  Eq.(8)  becomes 

n  1 

in(x)  =  i(x)+i(-x)^^ 

k»l  ^  — 

As  for  the  previous  regions,  the  size  of  this  region  is  equal  to  the  area  of  the  image  times  the  probability  that  a 
point  is  in  this  region  which  is  given  by 


(17) 


(18) 


P{w„(x)=l  and  w„(-x)=0}  =  P{i„(x)>0  and  i„(-x)S0} 


and  the  MSE  in  this  region  after  n  iterations  is  given  by 


MSE^ 


region  1 


regionl 


n(x) + [n(-x) + o(-x)]5^^ 


k=I 


w„(x)=l  and  w„(-x)=0 


(20) 


All  the  above  equations  assumed  that  the  teal  part  of  the  noise  was  less  noise  than  the  imaginary,  and  so  the  real 
part  of  the  iterated  Fourier  data  was  constrained  to  match  the  measured  data,  while  the  imaginaiy  part  was  left 
totally  unoonstrained.  If  the  imaginary  part  is  less  iK>i^  than  the  real  part  of  the  measured  Fourier  data,  the 
imaginaiy  would  be  constrained  and  tte  teal  would  be  left  totally  uncemstrained.  Because  the  positivity  constraint 
dramatically  alters  the  dc  value  of  the  image,  the  al^rithm  which  constrains  just  the  imaginaty  can  allow  large 
errors  to  occur.  As  a  result,  when  the  imaginaiy  is  less  noisy  than  the  real,  all  the  imaginary  vidues  of  the  iterated 


data  are  constrained  to  match  the  measured  data;  but,  in  addition,  the  dc  value  of  the  iterated  data  is  constrained  to 
stay  within  ±2o  of  the  measured  dc  value.  This  modification  of  the  algorithm  makes  theoretical  predictions 
difficult  since  the  algorithm  has  become  nonlinear.  Therefore,  for  this  case  only  computer  simulatitms  Mill  be  run. 

Summarizing,  positivity  behaves  as  a  signal*  and  noise-depenctent  su]q|x»t  constraint  which  changes,  in 
general,  on  each  iteration.  No  noise  reduction  occurs  in  the  region  of  the  synunetric  positivity-enforced  siq^ort, 
and  the  only  nc^  reduction  that  occurs  outside  the  positivity-enforced  constraint  results  from  zeroing  out  negative 
numbers,  ^ectively,  the  noise  changes  that  occur  inside  the  object's  true  support  occur  in  the  asyrrunetric  part  of 
the  posithdty-oonstrained  siqjport,  both  because  noise  valu«  ch^e  on  each  iteration  and  also  because  the  size  of 
the  positivity-enforced  asymm^c  support  changes  in  size.  Thus,  the  role  positivity  plays  in  error  reduction  is 
very  much  like  siqipmt  constraints,  where  correlation  of  Fourier  qrectra  bring  about  noise  changes  in  the 
asymmetric  part  of  the  siqrport  constraint.  The  major  difference  between  positivity  and  support  is  that  positivity- 
enforced  sunmrt  constraints  can  change  each  iteration,  while  support  constraints  do  not. 

3.  Cmnnuter  simulation  reailts 

In  this  section,  corrqHiter  simulation  results  are  presented  both  to  validate  the  theoretical  results  presented 
in  Section  2  and  to  show  grtqrhically  the  effect  positivity  has  on  noise  properties.  Because  probabilities  a^ 
erqrected  values  must  be  calculated  for  sums  random  variables,  the  noise  corrupting  the  image  was  clmsen  to  be 
the  sum  of  two  gaussian  stochastic  processes  ng(x)  and  no(x)  which  satisfy 


(n,(x,)n,(x2))  =  o^8(x,-Xj)+o28(x, +X2) 

{n„(x,)no(x2))  =  o^S(x,  -X2)-o^6(x,  +X2)  (21) 

(n,(x,)no(x2))  =  0 

in  order  to  make  calculations  tractable.  This  form  of  image  domain  noise  results  in  Fourier-domain  noise  which  is 

effecdvely  wide-sense  stationary  except  at  dc.  If  is  less  than  o^,  the  real  part  of  the  Fourier  data  is  less  noity 
than  the  imaginaty,  and  vice  versa.  In  addition,  since  the  statistical  quantities  are  dependent  iqxm  o(x),  for 
sinqilicity  o(x)  was  chosen  to  be  constant  inside  a  triangular  siq^xrrt  region  and  zero  outside. 

The  first  ccmiputer  simulations  used  an  image  with  an  average  SNR  of  0.5  inside  the  object's  true  siqiport 
In  Figures  1  and  2,  normalized  mean  square  error  plots  inside  the  object's  true  siqrport  constraint  are  shown  for  the 

atymmetric  and  symmetric  siqjport  regions,  respectively,  and  0.1.  In  Figures  3  and  4,  the  same  plots  are 

shown  for  all  the  same  values  except  o^/Oq  =  10.  In  e^h  figure,  the  MSB  for  a  positivity  constraint,  siq^it 
constraint,  and  both  positivity  and  support  ate  showa  For  the  supprm  constraint  MSB  determination,  at  each 
iteration  the  image's  negative  values  were  zeroed  before  error  calculations,  but  the  negative  numbers  were  restored 
before  the  next  application  (tf  siqqxrrt  constraints.  This  allowed  a  mote  foir  conqxurison  between  the  three  types  of 

omstraints.  For  the  positivity  case,  theoretical  values  determined  from  the  results  in  Section  2  for  o\la\-0.\ 
are  also  diowa  Notice  that  in  the  atymm^c  region  of  the  true  siqqxrrt  positivity,  su{^rt,  and  both  positivity  and 
siqrport  all  achieved  qrproximately  tte  same  error  reductions.  However,  in  the  tynunetric  region  of  tte  siqiport 
positivity  with  and  without  siqqxirt  constraints  resulted  in  lower  values  than  for  siqiport  alone  (where  no  noise 
reduction  occurred).  This  is  due  to  negative  image  values  inside  the  tymmetric  part  rtf'  the  true  support  constraint 
resultirig  in  a  noise-induced  asymmetric  siqqwrt,  which  results  in  reduced  MSB.  Also  notice  that  using  both 
positivity  and  siqqiort  as  a  constraint  sometimes  resulted  in  the  same  MSB  plots  as  with  just  positivity  or  siqqwrt 
altme,  and  other  times  it  results  in  MSB  plots  which  were  in  between  the  error  plots  resulting  from  using  eitl^ 

siqqxnt  or  positivity  alone.  Notice  that  the  results  ate  quite  siinilar  for  both  0^/0^  =0.1ando^/Oo 

Next,  the  simulations  were  run  for  the  same  scenario  as  above  excqjt  that  the  average  SNR  inside  the 
ot^'s  true  siqqxM  was  chosen  to  be  1.  It  can  be  seen  from  Figures  5-8  that  positivity  alone  is  becoming  less 
effixtive  as  a  constraint  when  compared  to  siqqiort  or  both  support  arxl  positivity.  Firially,  conqmter  simulations 
were  run  fm  an  average  SNR  of  5.  The  results  are  in  Figures  9-12,  and  it  can  be  seen  that  positivity  alone  as  a 
constraiiit  is  much  less  effective  than  siqqiort,  and  whoi  positivity  and  siqqiort  are  both  applied  the  results  are 


Figure  1.  Normalized  MSE  inside  asymmetric  part  of  object's  true  suiqx>Tt  for  SNR=O.S,  o^/Oq  =0.1.  Thedotted 
line  is  fisr  a  siq)pott  constraint,  tire  dashed  line  is  for  both  siqqreri  and  positivity,  and  the  solid  line  is  for  positivity 
alone.  The  triangles  denote  theoretically  calculated  points  for  positivity  constraint  alone. 


Number  of  Iterotions 


Figure  2.  Normalized  MSE  inside  symmetric  part  of  object's  true  support  for  SNR=0.S,  =0. 1.  The  dotted 
line  is  for  a  support  ctmstiaint,  the  dashed  line  is  for  both  suf^rt  and  positivity,  and  the  solid  line  is  for  poritivity 
akme.  Hie  triangles  denote  thetnetically  calculated  points  for  positivity  constraint  alone. 


C-8 


Figure  3.  Normalized  MSB  inside  asymmetric  pan  of  object's  true  support  for  SNR=O.S,  al  /  al  =10.  The  dotted 
line  is  for  a  siqiport  constraint,  the  dashed  line  is  for  both  support  and  positivity,  and  the  solid  line  is  for  positivity 
alone. 


Figure  4.  Normalized  MSB  inside  symmetric  part  of  object's  true  siq^it  for  SNR=0.5,  al  /  =10.  The  dotted 

line  is  to  a  support  constraint,  the  dashed  line  is  for  both  nipport  and  positivity,  and  the  solid  line  is  for  positivity 
alone. 
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indistinguishable  from  using  stq^rt  alone.  This  is  as  expected  since,  with  higher  SNRs,  the  noise  rarely  results  in 
negative  image  values  inside  the  true  siqqwrt,  and  so  positivity  has  little  impact  on  providing  a  sl^)port  constraim. 

4.  Ctmclusions 

An  analysis  has  been  provided  which  shows  the  effect  that  positivity  has  iqxrn  noise  reduction  in  images 
fi»'  the  case  of  wide>sense  stationary  Fourier  domain  noise.  It  has  b^n  shown  theoretically  and  with  the  use  of 
omnputer  simulations  that  positivity  as  a  constraint  acts  as  a  signal-  and  noise-dependent  support  constraint.  There 
are  two  mechanisms  by  which  positivity  causes  noise  reduction  inside  the  true  sunwrt  of  Uk  object.  The  first 
mechanism  is  noise  reduction  in  the  asymmetric  part  of  the  support  constraint  diw  to  mismatches  between  the 
variances  of  the  real  and  imaginary  noises  comqrting  the  Fourier  qiectra.  The  second  mechanism  is  that  of 
rechicing  the  size  of  the  positivity-enfoiced  siqiport  constraint  due  to  negative  values  in  the  image.  Positivity  has 
been  shown  to  be  most  effective  for  images  with  SNRs  less  than  one,  and  essentially  ineffective  for  SNRs  greater 
than  five.  The  effect  of  positivity  was  compared  to  siq>port  via  computer  simulations,  and  it  was  shown  that 
positivity  and  su|qx>rt  had  comparable  effect  in  the  asymmetric  part  of  the  siqrport,  but  positivity  did  better  in  the 
symmetric  part  (tf  the  siqrport  for  low  SNRs  and  worse  for  high  SNRs.  Comparable  re^ts  were  olAained  with 

positivity,  on  average,  for  al  /  al  <1  and  ^1. 

Because  positivity  behaves  as  a  signal-  and  noise-dependent  siqrport  constraint,  it  follows  that  positivity 
works  1^  enforcing  correlations  among  Fourier  spectra  just  as  siq^rt  As  a  result,  the  noise  correlation 

properties  are  key  to  determining  how  effective  positivity  will  be  as  a  constraint. 
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Figure  5.  Normalized  MSB  inside  asymmetric  part  of  object's  true  siqrport  for  SNR=1.0,  The  dotted 

line  is  fiv  a  sqrport  oonsttairrt,  the  dashed  line  is  for  both  siqjport  and  positivity,  and  the  solid  line  is  for  positivity 
altme.  The  triangles  denote  theoretically  calculated  points  for  positivity  constraint  alone. 
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Figure  6.  Nonnalized  MSB  inside  synunetric  part  of  object's  true  siq)port  for  SNR=1.0,  /  Og  =0. 1.  The  dotted 

line  is  for  a  support  ocnstraint,  the  dashed  line  is  for  both  siq^wri  and  positivity,  and  the  solid  line  is  for  positivity 
alone.  The  triangles  denote  theoretically  calculated  points  for  positivity  constraint  alone. 


Figure  7.  Normalized  MSE  inside  asymmetric  part  of  object's  true  siqipoit  for  SNR-1,  al  /  al  =10.  The  dotted 
line  is  fiur  a  siqipmt  constraint,  the  dashed  line  is  for  both  siqqiort  and  positivity,  and  the  solid  line  is  for  positivity 
alone. 
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Figure  8.  Normalized  MSE  inside  symmetric  part  of  object’s  tr\ie  support  for  SNR=1,  al  /  al  =10.  The  dotted  line 
is  for  a  siqqport  constraint,  the  dashed  line  is  for  both  support  and  positivity,  and  the  solid  line  is  for  positivity 
alone. 
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Figure9.  Nmmalized  MSE  inside  asynunetric  part  of  object's  true  sui^rt  for  SNR=S,  o^/Og  =0.1.  Thedotted 
line  is  for  a  support  constraint,  the  dashed  line  is  for  both  suiqwrt  and  positivity,  and  the  solid  line  is  for  positivity 
alone.  The  triangles  denote  theoretically  calculated  points  for  positivity  constraint  alone. 
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Figure  10.  Normalized  MSE  inside  symmetric  part  of  object's  true  support  for  SNR=S,  o\lo\  =0.1.  Tlie  dotted 
line  is  for  a  siqiport  constraint,  the  dashed  line  is  for  both  sui^rt  and  positivity,  and  the  solid  line  is  for  positivity 
alone.  The  trimigles  denote  theoretically  calculated  points  for  positivity  constraint  alone. 


Figure  11.  Normalized  MSE  inside  asynunetric  part  of  object's  true  stqiport  for  SNR=S,  /  <j\  =10.  The  dotted 
liiK  is  for  a  siqtport  constraint,  the  dashed  line  is  for  both  support  and  positivity,  and  the  solid  line  is  for  positivity 
alone. 
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Figure  12.  Ntmnalized  MSB  inside  symmetric  part  of  object's  true  siq^rt  for  SNR=S,  a]  /  al  =10.  The  dotted 
line  is  for  a  siqiport  constraint,  the  dashed  line  is  for  both  siq^rt  and  positivity,  and  the  solid  line  is  for  positivity 
akme. 
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Abstract 

The  use  of  information  about  an  image  in  addition  to  measured  data  has  been  demonstrated  to  provide  the 
possibility  of  decreasing  the  noise  in  the  measured  data.  A  new  constraint,  recently  proposed,  is  that  of  perfect 
knowledge  of  part  of  an  image.  In  this  paper,  these  results  are  generalized  and  the  usefiilness  of  this  new 
constraint  to  decrease  noise  outside  the  region  of  prior  knowledge  is  shown  to  be  a  function  of  the  measured  data 
nmse-ctHrrelatkm  piopttties.  In  particular,  it  is  shown  that  prior  high-quality  knondedge  is  a  generalization  of 
siqtptHt  constraints. 
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1  imrwfaifliftn 

The  use  of  additional  information  for  error  reduction  in  images,  either  by  superresolution  or  noise- 
reduction  in  measured  data,  has  received  much  attention^*^.  The  types  of  additional  information  include 
infivmation  such  as  siq>port  regions,  positivity,  and  energy  constraints^,  as  well  as  others.  Recently,  it  has  been 
proposed*^  that  part  of  a  image  may  be  known  exactly,  and  this  can  be  used  as  a  constraint  to  decre^  noise  levels 
in  the  image  outside  the  region  of  perfectly  known  data.  In  this  p^rer,  the  results  in  Ref  7  are  generalized  and 
made  rigorous.  It  is  shown  that  high-quality  prior  knowledge  is  a  generalization  of  siq^rt  constraints,  and  thus 
the  at^ty  to  reduce  noise  levels  in  the  image  (Hitside  the  region  of  high-quality  data  is  a  function  of  the  statistical 
I»operties  of  the  noise  corrupting  the  image^. 


2.  TbWIV 

Let  an  estimated  image  be  given  by  o^fx).  Siqrpose  that  a  region  of  this  ima^  is  known,  by  some  means 
such  as  earlier  photogrqrhs  or  computer  moling,  widi  much  higher  (but  not  necessarily  perfect)  accuracy.  Let 
^(x)  denote  this  prior  i^rmation,  and  1^  Wp(x)  be  the  binary  stqrport  function  defining  this  regioa 
Fmthermore,  let  v^(x)  denote  the  binary  siq^rt  function  for  the  complement  of  this  region.  Then  the  corrqrosite 

image  o,(x)can  be  formed  as  foUows: 


0,(x)  =  W,(x)0e(x)  +  Wp(x)0p(x)  (1) 

Assuming  that  measured  Fourier  data  is  available,  along  with  an  estimate  of  its  variance,  it  is  now  necessary  to 
determine  the  effect  this  prior  knowledge  has  upon  the  quality  of  the  constrained  Fourier  qrectrum  relative  to  the 
measured  qiectrum.  Fourier  transforming  Eq.(l)  gives 


6,(u)=  Jw,(§)0.(u-^)d4+  |Wp(§)Op(u-§)d4 


=  Jw.(§)0„(u-§)d§-  Jw^(§)0^(u-§)d^+  j 


Jw„(4)0^(u-^)d^+  Jw^(^)0,(u-^)d^ 


+  Jw^(§)0^(u-^)d§-  JWpi(^)Opi(u-^)d^+  j 


JWp,(^)Op,(u-^)d^+  JWpi(^)Op,(u-^)d^ 


(2) 


where  the  subscripts  r  and  i  refer  to  the  real  and  imaginary  parts  of  a  complex  quantity,  respectively,  and  coital 
liters  denote  Fourier  transforms.  To  determine  the  change  in  quality  of  the  constrairied  Fourier  transform,  it  is 

necessary  to  calculate  the  variances  of  the  teal  and  imaginaty  parts  of  0,(u),  siitce  algorithms  using  this 
constraint  would  sedc  to  ctmstrain  the  modified  data  to  stay  close  to  the  measured  data.  This  can  be  acconqrlished 
in  a  straightforward  although  tedious  way.  To  simplify  matters,  assume  that  the  noises  corrupting  the  high-quality 
I»ior  knowledge  are  uncorrelated  with  noises  comqrting  the  measured  data.  Thus,  cross-covariance  terms  are  zero 
and  we  get 


var{6,(u)}  ■  <  l6„(u)f  >  -  <  6„(u) 


=  J  j|^W^(^)W^(C)covar{o^(u-4),O^(u-C)}  +  W^(4)W^(C)covar{o^(u-^),O^(u-0}jd^C 


+  J  J[w^(^)W^(C)covar{o^(u-4),O^(u-0}  +  Wp^(4)Wp^(C)covar{Op^(u-^),Op^(u-0}j(^dC 


-  2  J  J  W^(^)W^(C)covar{o^(u-^),0^(u-C)}  +  W^(^)W^(;)covar{o^(u-^),Op^(u-C)}jil^dC 


(3) 

In  tbe  case  of  high*quality  prior  data,  the  covariance  of  this  prior  data  is  much  less  than  the  covariance  of  the 
measured  data.  Thus  all  the  second  covariance  terms  in  the  integrals  are  insignificant  conq>ared  to  the  first,  so 
Eq.(3)  can  be  rewritten  as 


var{6,(u)}  -  JJw^(§)W^(C)covar{o^(u-4),0^(u-C)]d^C 


+  JJw^(4)W^(C)covar{o^(u-§),0^(u-C)]dyC 


-  2  JJw^(^)W^(C)covar{o^(u-4).0^(u-C)]d^C  (4) 

which  is  precisely  the  same  result^  as  is  obtained  if  the  object  had  sui^rt  Wg(x).  In  the  same  way,  the  variance  of 
the  imaginary  part  can  be  shown  to  be 


var{6,,(u))  -  JJw^(^)W^(C)covar{o^(u-4).0^(u-C)]d^C 


+  JJw^(§)W^(C)covar{o^(u-^),O^(u-0}d^dC 


+  2  JJw^(§)W^(C)covar{o^(u-^),0^(u-C)]d^C 


(5) 


D-4 


which,  again,  is  the  same  result  as  for  an  object  with  sun>ort  constraint  w^Cx).  Thus,  as  long  as  the  prior 
knowledge  is  much  less  noisy  than  the  measured  data  and  its  noise  is  uncorrelated  with  the  measured  data,  using 
the  prior  knowledge  is  effectively  the  same  as  applying  a  support  constraint.  As  a  result,  all  the  previously 
developed  sqiport  theory^  ^lies.  In  particular,  although  the  overall  noise  in  the  Fourier  domain  has  decreased 
since  noise  hiu  been  eliminate  in  the  image  domain,  it  is  the  behavior  of  the  variances  at  each  qratial  frequency 
that  determines  if  noise  reduction  (wtside  the  region  of  prior  knowledge  can  occur.  All  the  imise  reduction 
achieved  so  ftr  occurs  only  as  a  result  of  the  noise  removed  from  the  prior  knowledge  area. 

As  for  siq)port,  tte  prior  knowledge  must  cause  the  variances  in  the  constrained  Fourier  data  to  increase 
b^tmd  that  of  the  measured  Fourier  data  in  order  for  noise  reduction  outside  the  prior  knowledge  region  to  occur. 
As  for  the  support  theory^,  we  will  assume  Fourier  domain  wide-sense  stationary  noise  of  the  form 

N,(u)»0„(u)-e{0„(u)} 

Ni(u)-0^(u)-E{0^(u)} 

where  E{ }  denotes  «q)ected  value  and  the  complex  noise  (N(.,Ni)  is  a  stochastic  process  which  satisfies 


(N,(U,)N,(U2))  =  R,(U,-U2)  +  Rr(U,+U2) 

(Nj(u,)Ni(U2))  =  Ri(u,  -U2)-Ri(u,  +U2)  (7) 

{Ni(u,)N,(U2)>  =  <N,(u,)Ni(u2)>  =  0 


The  terms  invtdving  sums  of  ^tial  frequencies  will  be  neglected  since  they  only  have  an  impact  near  dc.  In 
particular,  fca  the  computer  simulation  results  in  Section  3,  the  noise  will  be  assumed  to  be  gaussian  and  delta- 
ocHrelaied  in  the  Fourier  domain;  that  is. 


(N,(U,)N,(U2))  =  oj6(u,-U2) 

(Ni(u,  )Ni(u2))  =  o?6(u,  -  U2)  (8) 

(Ni(u,)N,(u2))  =  (N,(u,)Ni(u2))  =  0 


3  TiMnnirter  .Simiilatinii  Remits 

The  algorithm  used  to  enforce  the  prior  knowledge  constraints  is  the  same  as  described  in  Ref.6;  here, 
only  a  summary  will  be  given.  The  algorithm's  steps  are;  (1)  in  the  image  domain,  rqrlace  the  measured  data  with 
the  prior  knowledge  in  the  region  where  priw  knowledge  is  available,  (2)  Fourier  transform,  (3)  if  the  real 
(imaginary)  part  of  the  measured  Fourier  data  is  less  noisy  than  the  imaginary  (real),  rqrlace  the  iterated  teal 
(imaginary)  part  of  the  Fourier  data  with  the  measured  d^  but  leave  the  imaginaty  (rc^)  undianged,  (4)  inverse 
Fourier  tran^srm,  and  (5)  go  bade  to  step  (1)  until  noise  is  minimized  outside  the  region  of  prior  knowledge.  As 
discussed  in  Ref.6,  this  point  of  minimum  noise  will  always  occur  prior  to  convergence  of  the  algorithm  as  long  as 
the  variances  of  both  the  real  and  imaginaty  parts  of  the  measured  Fourier  data  are  nonzero. 

The  picture  in  Figure  1  is  the  true  image  used  for  demonstrating  the  effectiveness  of  high-<]uality  prior 
data.  Figure  2  shows  this  picture  comqrted  with  Fourier  domain  wide-sense  stationary  noise  as  in  ^.(8),  with 

of  /of =02  and  an  average  signal-to-noise  ratio  (SNR)  in  the  image  domain  of  1.  The  algorithm  described  above 
was  run  for  20  itaafions,  and  the  prior  knowledge  was  assumed  to  be  perfect  and  in  the  lower  rigjit-hand  quadrant 
of  the  image.  Because  the  noise  is  wide-sense  stationary,  the  only  error  reduction  predicted  by  theory  is  in  the 
asymmetric  part  ci  the  siq)pott  of  the  noisy  data.  Figure  3  shows  the  noisy  image  with  the  high-quality  prior 
knowledge  insetted  but  before  the  algcnithm  has  been  run,  and  Figure  4  shows  the  resulting  image  after  running 
the  algorithm.  As  can  be  seen,  error  reduction  only  occurred  in  tte  asynunetric  part  of  the  suiqrort  of  the  noity 
data. 


Since  the  imor4aiowledge  ccmstniint  is  effectively  a  support  constraint,  the  theory  develr^red  in  Ref.6  can  be  used 
to  predict  the  error  reductitm  in  the  image  at  each  step  of  the  iteration.  Figure  S  contains  this  compariscm  between 
thmry  and  coirqxiter  simulation.  Notice  the  close  match  between  theory  and  simulation.  Also,  notice  that  the 
pt^  of  minimum  noise  (at  the  6th  iteration)  is  barely  discernible.  This  is  due  to  the  large  mismatch  between  the 
real  and  imaginary  variances.  In  addition,  although  it  is  not  shown  in  Figure  5,  the  error  in  the  syrrunetric  part  of 
the  measured  data  siqrport  remained  unchanged,  as  predicted  by  theory. 

4.  Conclusions 

Prior  high-quality  knowledge  of  part  of  an  image  is  a  generalization  of  siqqxrrt  constraints,  and  can  be 
used  to  reduce  the  noise  in  the  measured-^ta  part  of  the  image.  The  ability  of  prior  knowledge  to  reduce  noise 
outside  the  region  of  prior  knowledge  dqrends  iqxrn  the  noise  correlation  pnqrerties. 

ActaMiwIedimiMiK 

This  research  was  funded  by  a  grant  fiom  the  U.S.  Air  Force  Office  of  Scientific  Research,  Bolling  AFB, 
Washington,  D.C. 

Befiacaccs 

1.  G.  Demoment,  "Image  reconstruction  and  restoration;  overview  of  common  estimation  structures  and 
probimns,*  IKRF.  Trans  Aooust..  Speech  Siynal  Pmn^ing  vol.37,  pp.2024-2036  (1989) 

2.  M.I.  Sezan  and  A.M.  Tekalp,  "Surv^  of  recent  develqrments  in  digital  image  restoration,”  Opt.Eng..  vol.29, 
pp.393-404  (1990) 

3.  H.  Start,  editor.  Image  Recovery;  Theory  and  AoolicatiorL  Academic  Press,  Orlando,  FL  (1987) 

4.  C.L.  Matson,  "Noise  reduction  in  additive  optics  imagery  with  the  use  of  siqrport  constraints,”  to  be  subrtritted 
to  Applied  Optics  (Dec  1993) 

5.  C.L.  Matsim,  "Fourier  qrectrum  extrapolation  and  enhancement  using  support  constraint,"  to  appear  in  the 
IEEE  Trans.  Signal  Proc.,  January  1994 

6.  CL.  Matson,  "Variance  reduction  in  Fourier  qrectra  and  their  corresponding  images  with  the  use  of  support 
constraints,"  to  appeal  in  the  J.Opt.Soc.Am.A.,  January  1994 

7.  R.A.  Carreras,  "Image  restoration  using  nonlinear  (qitimization  techniques  with  a  knowledge-based  constraint," 
Proc.SPIE,  vol.2029,  pp.209-226  (1993) 


Image  Error 


Figure  4.  Nmmalized  mean  square  error  in  the  iterated  image  as  a  function  of  iteration  number.  The  solid  line  is 
the  themetical  prediction,  and  symbds  denote  corrqmter  simulation  values. 


APPENDIX  E 


Noise  reduction  in  adaptive  optics  imagery  with  use  of  siq^rt  constraints 


Charles  L.  Matson 

Phillips  Laboratory/LIMI,  Kirtland  AFB,  NM  87117 
Michael  C.  Roggemaim 

DqM  of  Engr  Physics,  Air  Force  Institute  of  Technology,  Wright  Patterson  AFB,  OH  4S433 


Abstract 

The  use  of  siqiport  ccmstraints  for  noise  reduction  in  images  obtained  with  telescopes  that  use  adaptive  optics  for 
atinoq)heric  correction  is  discussed  in  this  paper.  Noise  covariances  are  derived  for  this  type  d  data,  including  the 
effects  d  shot  noise  and  CCD  read  noise.  The  effectiveness  of  support  constraints  in  achieving  noise  reductum  is 
discussed  in  terms  of  these  noise  properties  and  in  terms  of  the  type  d  algorithms  used  to  enforce  the  siqiport 
cmistrainL  Both  a  convex  projections  and  a  cost  function  minimization  algorithm  are  used  to  enfmce  the  siq>p(m 
omstraints,  and  it  is  diown  via  computer  simulation  and  field  data  that  the  cost  function  algorithm  results  in 
artifiKts  in  the  reoonstructioiis.  The  convex  projections  algorithms  produced  mean  square  error  decreases  in  the 
image  dmnain  of  tqiproximately  10%  for  high  light  levels,  but  essentially  no  error  decreases  for  low  light  levels. 
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1  Ifimnliictiftn 

Atmospheric  tiubulence  has  long  been  recognized  as  the  limiting  factor  in  ground-based  tekscqw 
reaidution.  Wavefioot  sensing  and  ad^^tive  optics  have  been  proposed  as  a  method  to  lessen  the  intact 
atmoqtheric  turbulence  dist(»tion^>^.  This  approach  has  indeed  been  successful  in  generating  subdantially  higher 
resolution  frmn  ground-based  telescopes  than  otherwise  achievable^*^.  However,  deq;>ite  the  m^hod  of  image 
reconstruction  and  amount  of  image  quality,  the  use  of  additional  information  beyond  that  of  the  measured  drna  to 
irtqrrove  image  quality  has  bemi  pursued  for  many  decades^.  One  particular  type  of  arhUtumal  information, 
siqtport  oonstraitus,  has  long  berm  rec^nized  as  a  means  to  siqrerresolve  data  in  the  Fourier  domain  beyond  the 
measurement  region^*^^.  Recently it  has  been  shown  that  support  constraints  provide  a  means  to  irtqrtove 
the  quality  of  the  measured  data  itself  in  addition  to  providing  a  means  for  superresolution.  The  ability  to  iminove 
the  measured  data  has  been  shown  to  be  a  function  the  statistical  properties  of  the  noise  corrupting  the  measured 
data.  In  this  paper,  this  recent  theory  is  applied  to  imagery  obtained  from  telescopes  enqrloying  ad^ve  optics  for 
atmoq;>heric  correction.  The  outline  the  paper  is  as  follows;  the  necessary  statistical  pn^rties  of  the  measured 
data  are  derived  in  Section  2,  and  the  algorithms  used  to  enforce  support  constraints  are  described  in  Section 
3.  Sectirm  4  contruns  results  from  both  computer  simulations  and  field  data,  and  Section  5  contains  the 
conclusions. 


2.  Noise  CovariarKses  in  Adaptive  OtitiCT  lmare^ 

It  has  been  previously  shown^*^'^  that  the  noise  correlation  properties  in  measured  data  are  key  to 
determining  how  e£foctive  siqiport  constraints  can  be  in  acconqrlishing  noise  reduction  in  images.  Therefore,  in 
this  sectitm,  the  noise  covariances  will  be  derived  for  ad^)tive  qMical  imagery.  The  three  noise  sources  considered 
are  photon  noise,  CCD  read  noise,  and  noise  resulting  from  imperfect  atmospheric  distortion  removal  by  the 
ad^tive  optic  tystem. 

The  ddected  image,  d(x),  is  given  by 


K 

<i(x)=5^S(x-Xk)+nccD(x)  (1) 

k<il 

where  K  is  the  munber  of  detected  photons  and  the  effects  of  SKdial  integration  due  to  finite  detector  size  are 
neglected.  The  noise  term  rt^^^^^Ix)  is  assumed  to  be  zero  mean  and  delta-correlated  with  variance  r(x).  This 
cmrespoods  to  idealized  CCD  read  noise  with  the  flat-fielding  and  bias  removal  already  accomplished.  The 
Fourier  fransform  of  d(x),  D(u),  is  given  by 


K 

D(u)  =  5]e-j^‘-hNccD(u)  (2) 

k>l 

It  is  straightforward  to  show  that  the  expected  value  of  D(u),  E{D(u)},  is  given  by 

E{D(u)}=KO„(u)H(u)  (3) 

where  K  is  the  average  pht^ons  per  frame,  Oq(u)  is  the  true  object  Fourier  spectrum  normalized  to  one  at  dc,  and 
H(u)  is  the  average  (^cal  transfer  function  of  the  atmos>here  and  telescqx  with  adaptive  optics  and  is  realms 
The  covariances  of  the  real  and  imaginaiy  parts  of  D(u),  as  well  as  the  cross-correlation  between  the  real 
and  imaginary  parts,  will  now  be  derived,  as  these  are  the  specific  statistical  ejqnessions  needed  for  predicting  the 
performance  of  the  deconvolution  algorithms.  Let  the  sidtscriiMs  r  and  i  denote  the  real  and  imaginary  parts  of  a 
conqrlex  quantity,  reqrectively.  Then 


covar{D,(u),Dr(v)}  =  E{D,(u)Dr(v)}-  E{D,(u)}e{D,(v)} 
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=  e|  ^  cos(2«uXk  )^cos(2kvx„  )  i  +  E{NccD,(u)NccDr  (V )}  -  K^H(u)H(v)0„  (u)0„  (v )  (4) 


Lk-l 


msl 


covar{D,(uXDi(v)}  =  E{D,(u)D,(v)}  -  E{D,(u)}e{d,(v)} 


=  E 


I 

]^sm(2iniXk)J]^sin(2iivx„)UE{NccD.(“)NccD.(v)}-K^H(u)H(v)0„(uX)„(v)  (5) 

k>l  mal  I 


covar{D,(u).Di(v)}  =  E{D,(u)Di(v)}-E{D,(u)}E{Di(v)} 


=  E 


5^cos(2TOiXk)]^siii(2jivx„)UE{NccDr(“)NccDi(v)}-i^H(u)H(v)0„(u)0„(v)  (6) 


L  k«l  fB»t  J 

where  the  equalities  are  obtained  by  noting  that  the  CCD  read  noises  are  independent  of  all  other  noise  sources. 
Following  standard  covariance  calculation  methods^^’^^,  it  can  be  shown  that 


cofvar{D,(u),D,(v)}  =  YO„(u-v)H(u-v)+YO„(u+v)H(u  +  v)+-jR,(u-v)+^R,(u+v) 

+iC^O„(u)0„(v)covar{NAOr(u).NAOr(v)}+i?Ooi(u)0^(v)covar{NAa(u),NAOj(v)}  (7) 


covar{Di(uXDi(v)}  =  ^0„(u-v)H(u-v)— ^0„(u+v)H(u+v)+-^R,(u-v)-iR,(u+v) 

A  Zf  ^  A 

+K^O^  (uX)„i  (V  )covar{NAo,  (u),  N^or  (v )}  +  K*0„  (u)0„  (v  )covar{N  ^oi  (u).  N  ^oi  (v)}  (8) 


covar{D,(u),Di(v)}  =  -YO^(u-v)H(u-v)+yO^(u+v)H(u+v)-YRi(u-v)+-iRi(u+v) 

+K^O„(u)0^(v)covar{NAOr(uXNAo,(v)}-^0^(u)0„(v)covar{NAOi(u),NAOi(v)}  (9) 

wlKre  R(u)  is  the  Fourier  transform  of  r(x),  and  ^  associated  with  the  imperfect  ad^dve  (q>tics 

(AO)  correction.  Used  in  the  derivation  of  Eqs.(7)-(9)  is  the  fKt  that  the  real  and  imaginary  parts  of  are 
uncorrelated.  The  first  two  terms  in  Eqs.(7H9)  are  due  to  photon  noise,  the  second  two  terms  are  due  to  CCD  read 
noise,  and  the  last  two  terms  are  due  to  AO  noise.  No  clos^  form  expression  is  available  for  However, 
accurate  conqniter  simulations^  can  be  used  to  determine  the  structure  of  the  variances  and  covariances  of  for 
desired  telesarpe/rg/AO  combinations.  For  the  computer  simulations  discussed  in  this  papa,  two  combinations 
were  utilized.  The  first  condanation  assumes  D/r^,  =5,  one  «;tuator  per  r^  cell,  and  a  one  meter  unobscured 
q)ertute.  The  second  combination  assumes  D/Tq  =16,  one  actuator  per  r^  cell,  and  a  1.6  meter  obscured  aperture, 
llus  combination  is  a  model  of  the  1.6  meter  compensated  telescq)e  at  the  Air  Force  Maui  Optical  Station 
(AMOS).  Radially  averaged  variances  of  for  the  first  and  second  combinations  are  shown  in  Figure  1.  Notice 
that  there  is  a  marked  dissimilarity  in  the  magnitudes  of  the  noises  for  most  ^tial  fiequencies.  This  dissimilarity 
implies  the  possibility  of  noise  reduction  with  the  use  of  suiqwrt  constraints^"^,  but  in  fact  this  does  not  occur,  as 
will  be  shorra  in  the  next  section.  This  is  due  to  the  fact  that  the  correlation  of  the  noises,  as  well  as  their  relative 
magnitudes,  determine  the  ability  of  siqqmrt  constraints  to  cause  error  reduction^^>  The  correlation  coefficients 
of  the  covariances  can  be  seen  in  Figure  2.  This  plot  is  for  the  first  combination  and  assumes  that  the  correlation 
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Figure  1.  Adaptive  optics  noise  variances.  Curves  (1)  and  (2)  are  the  radially-averaged  real  and  imaginaiy  noise 
variances  for  combination  1  described  in  the  text,  respectively,  while  curves  (3)  and  (4)  are  the  radially-averaged 
real  and  imaginary  noise  variances  for  combination  2. 
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Figure  2.  Adaptive  qi^cs  noise  correlation  coefficients  for  combination  1.  The  solid  line  is  a  plot  of  the 
compensated  OTF,  while  the  triangles  are  computer  simulation  points  for  the  real  correlation  coefficients  and  the 
asterisks  are  conqmter  simulation  points  for  the  imaginary  correlation  coefficients. 
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coefBcients  are  independent  of  location  and  orientation,  which  is  a  simplifying  assumption.  Also  plotted  with  the 
correlation  coefficients  is  the  OTF  of  the  atmosphere/telescope  combination.  The  inverse  Fourier  transform  of  the 
OTF  is  essentially  finite  in  extent  and  this  finite  extent  enforces  correlation  among  the  noises  in  the  Fourier 
domain.  As  expected,  the  shape  of  the  OTF  provides  a  lower  limit  to  the  correlation  of  the  adaptive  q)tics  noise. 
Notice  that  the  real  part  of  the  noises  are  much  more  correlated  than  the  imaginary  parts  of  the  noise.  The  large 
amount  of  correlation  is  the  determining  factor  in  the  amount  of  noise  reduction  achievable  using  siqjport 
constraints.  Because  the  noises  are  so  highly  correlated,  the  covariances  in  Eqs.(7)-(9)  can  be  aiqrroximated  by 
their  variances,  which  results  in 

covar{D,(u),D,(v)}--jO„(u-v)H(u-v)+YO„(u+v)H(u  +  v)+-jR,(u-v)+-jRr(u+v) 

+K^0„(u)O„(v)var{NA0r(u)}  +  K^O„(u)0ni(v)var{NAOi(“)}  (10) 


covar{Di(uXDi(v)}-yO„(u-v)H(u-v)-YOn,(u+v)H(u+v)+-jR,(u-v)— jR,(u+v) 

+K^O„  (u)Oni  (V  )var{NAOr  («)} + K^O„  (u)0„  (v)  var{N  AOi  (u)}  (11) 

covar{D,(u),Di(v)}--YO^(u-v)H(u-v)+yO^(u+v)H(u+v)— jRi(u-v)+yRi(u+v) 

+K20„(u)0^(v)var{NAo,(u)}-K"0^(u)0„(v)var{NAOi(u)}  (12) 


3.  Algorithm  Description  and  Performance  Prediction 

In  this  section,  the  two  algorithms  used  to  enforce  siq^rt  constraints  in  the  deconvolution  process  will  be 
described.  Predictions  of  their  performance  will  also  be  analyzed  in  terms  of  the  noise  correlation  pnqrerties 
developed  in  the  previous  section.  It  is  assumed  that  an  unbiased  estimate  of  the  true  Fourier  data  exists,  along 
with  an  unbiased  estimate  of  the  variances  of  the  estimate  of  the  mean.  It  is  also  assumed  that  the  estimated 
Fourier  data  exists  only  in  a  finite  region.  For  the  results  in  this  p^r,  it  is  assumed  that  this  region  is  roughly 
centered  at  dc  and  the  outer  limits  are  determined  either  by  a  low-pass  filter  such  as  a  telescope  causes  (in  the 
infinite  signal-to-noise  (SNR)  case)  or  the  outer  limits  are  determined  by  the  SNR  of  the  data  becoming  sufficiently 
small  that  only  noise  exists  outside  these  limits.  However,  these  results  are  easily  generalized  to  the  case  where  a 
number  of  finite  regions  of  Fourier  data  are  measured  such  as  in  interferometry. 

Convex  Projections 

The  first  algorithm  to  be  described  is  a  convex  projections  an>roach)^~^(^.  The  steps  of  the  algorithm  are 
as  follows:  (1)  ai^ly  siq>port  constraints  in  the  image  domain,  (2)  Fourier  transform  the  support-constrained  data, 
(3)  modify  the  siqiport-constrained  Fourier  data  so  that  it  stays  within  a  ±2o  region  about  the  measured  n^an 
where  measured  data  is  available,  and  constrain  the  magnitude  of  the  support-constrained  data  to  stto^  near  zero 
outside  of  this  regiott,  (4)  inverse  Fourier  transform  the  data,  (S)  go  to  step  1  and  continue  until  the  image  changes 
are  insignificant.  The  most  inqwrtant  conceptual  step  in  this  algorithm  is  step  (3).  If,  after  flying  siq)port 
constraints,  the  stqrport-constrained  Fourier  data  is  within  the  ±2o  measured  data  region,  support  constraints 
cannot  change  the  noise  properties  in  the  image  domain  inside  the  support  constraint  because  no  changes  can  be 
made  in  the  Fourier  domain.  Therefore,  the  key  to  the  usefulness  of  sujqxtrt  constraints  is  the  effect  they  have 
tqwn  the  iterated  Fourier  data.  To  analyze  this  further,  let  O^fu)  be  the  iterated  Fourier  data  after  one  application 
of  su{q)ort  constraints.  Following  the  development  in  Ref  14,  the  variance  of  the  real  and  imaginaty  parts  of  Og(u) 
are  given  by 
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var{0,(u)}  =  JJw^(^)W^(C)F(u-^)F(u-C)covar{D^(u-^),D^(u-C))d^C 


+  J  J  W.(4)Wi(C)F(u-  4)F(u  -  C)covar{D.(u  -  ^).Di(u  -  C)]d^C 

•e 

-  2||w,(4)W,(C)F(u-^)F(u-C)covar{D,(u-4).D.(u-0]d4dC  (13) 


and 


var{0^(u)}  =  JJw  (4)W  (OF(u-^)F(u-C)covar{a(u-4).D.(u-C)]d4dC 


+  JJWi(W(C)F(u-4)F(u-C)covar{D,(u-§),D,(u-C))d^C 
+  2  JJw,(^)Wi(C)F(u-§)F(u-C)com{Di(u-^).D,(u-C))d^C  (14) 


where  F(u)  is  a  real  filter  which  deconvolves  out  H(u)  and  filters  the  renting  Fourier  q)ectnun  to  minimize  the 
noise  amplification  effects,  and  W(u)  is  the  Fourier  transform  of  the  support  constraint  w(x).  It  is  necessary  to 
insert  Eqs.(10)-(12)  into  Eqs.(13)  and  (14)  to  analyze  the  variances  fiulher.  This  will  be  done  for  two  limiting 
cases:  high  light  level  and  low  light  level. 

In  the  high  light  level  case  (infinite  SNR),  the  last  two  terms  in  Eqs.(10H12)  dominate  the  covariances. 
Substituting  these  equations  with  this  simplification  into  Eq.(13)  gives 


varHi.{0,(u)}  -  K2F='(u)var{NAOr(u)}  JJw  (^)W  (C)0„(u-^X)„(u-C)d^C 


+K'F'(u)var{NAOi(u)}Jjw(^)W^(CP^(u-^)0_.(u-C)d^dC 


+ F^(u)var{N Aor  (u)}  J  J  W  (4)W  (C)0_^  (u  -%yOJu-  i;)d^dC 


+  K2F2(u)var{N^o.  (“)}  J  J  W (4)W(C)0_^(u  -  ^yOJu  -  Od^dC 


-  2K2F^(u)var{NAo,(u)}  JJw  (^)W.(C)0^(u-4)0^(u-C)d^C 


+  2K¥^(u)var{NAo.(u)}  JJw^(4)W(C)0^(u-^)0^(u-C)d^C  (15) 


where  F(u)  is  assumed  2q)proximately  constant  in  the  region  where  the  integrands  of  Eq.(lS)  are  significantly 
nonzero.  This  ^roxiination  is  reasonably  valid  where  the  object  is  significantly  larger  than  the  width  of  tltt 
inverse  Fourier  transform  of  F(u),  which  should  be  the  case  when  the  object  is  well>resolved  by  the  telescqx. 
Furthermore,  the  integrals  in  Eq.(lS)  are  multiplications  of  convolutions  which  can  be  simplified  to  obtain 


varHL{0,(u)}  -F^(u)[K*Oi(u)var{NAOr(u)}+K*0^(u)var{NAOi(u)}]  (16) 

where  the  term  in  the  square  brackets  is  seen,  by  Eq.(lO),  to  be  the  variance  of  the  real  part  of  the  measured 
Fourier  data,  and  thus  ^.(16)  reflects  the  starting  variance  of  the  real  part  of  the  measured  data  scaled  by  the  filter 
F(u).  In  the  same  w^,  it  can  be  shown  that 


varHL{0.i(u)}  -  F^(u)[K^O^(u)var{NAOr(u)}+K^O^(u) var{NAOi (u)}]  (17) 

which  is  the  starting  variance  of  the  imaginary  part  of  the  measured  data  scaled  by  F(u),  as  well.  As  a  result,  the 
variances  of  the  support-constrained  Fourier  data  are,  on  average,  the  same  as  tte  variances  of  the  measured 
Fourier  data.  This  means  that  most  of  the  siq^rt-constrained  Fourier  spectrum  will  reside  inside  the  ±2a  region 
and  thus  the  triplication  of  siqiport  constraints  will  not  have  much  effect  on  noise  reduction  insirte  the  siqriort 
constraint  due  to  the  inability  of  the  measured  data  to  act  as  an  effective  constraint.  The  reason  that  siqiport 

constraints  do  not  allow  noise  reduction  is  that  the  noises  are  too  conelated,  which  results  from  var{NAOr  (u)}  > 

var{NAOi  (u)}>  and  F(u)  being  essentially  constant  where  the  integrands  are  significantly  nonzero,  which  is  only  an 
tqiproxiination.  As  a  result,  some  variance  modification  can  occur  as  a  result  of  siqr>ort  constraints  since  these 
terms  are  not  exactly  constant  as  previously  assumed.  However,  although  the  terms  are  not  exactly  constant,  they 
are  still  closely  ^roximated  by  a  constant,  so  not  much  noise  reduction  is  eiqiected  in  this  case.  Looking  again  at 

Figure  1,  it  can  be  seen  that,  in  some  regions,  varfNAo  (u)}  and  var{NAOi  (u)}  are  changing  quite  r^idly.  Thus 
snne  nmse  reduction  in  images  due  to  the  constraining  of  tire  support-constrained  Fourier  data  to  remain  in  the 
measured  data  ±2a  region  should  occur,  tnit  inobably  ntrt  much.  In  addition,  this  result  assumes  that  the  region  of 
integratum  airere  the  integrand  is  significantly  nonzero  is  contained  inside  the  region  of  measured  data.  However, 
in  r^ons  irear  the  edge  of  the  measured  data,  the  zeros  representing  the  non-measured  data  will  be  correlated  in 
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via  the  integrals  in  Eqs.(13)  and  (14),  and  thus  the  variances  of  the  support-constrained  Fourier  data  will  become 
significantly  worse  near  the  data  region  edges,  in  general.  Although  this  does  not  inqrrove  the  quality  of  the 
measured  Fourier  data,  it  extends  the  measured  data  out  into  regions  where  no  data  was  measured.  This  is  the 
essence  of  siqrerresolution. 

Consider  now  the  low  light  level  case,  where  photon  noise  dominates  and  CCD  read  noise  is  not  an  issue. 
Then  the  first  two  terms  in  Eqs.(10)-(12)  are  dominant  and,  looking  at  the  \'ariances  of  the  real  part  of  the  siq^rt- 
constrained  Fourier  data,  Eq.(13)  becomes 


varu.{0,(u)}  -  -yF^Cu)  JJw^(^)W^(C)[o^(C-4)H(C-^)+0^(2u-C- Wu-C-^)]tl^C 


+  -jF^Cu)  JJW.(^)W.(C)[0„(C- WC-4)-0„{2u-C- W2u-C-^)}l^dC 


+  KF2(u)|Jw,(4)W.(C)[0^(C-4)H(C-4)-0^(2u-C-^)H(2u-C-^)]d^dC  (18) 


The  first  term  in  the  brackets  in  the  integrands  of  Eq.(18)  is  a  fimction  only  of  the  difference  in  ^tial  fiequencies. 
Without  the  filter  F(u)  effects  or  the  second  terms  in  the  bradrets  (which  are  only  significant  near  dc)  the  noise 
model  would  fit  the  wide-sense  stationary  model  assumed  in  Ref.l4  and  the  variances  of  the  real  and  imaginary 
parts  of  the  measured  data  would  be  equal.  It  has  been  shown^'^  that  this  type  of  noise  results  in  no  noise 
reduction,  and  even  a  slight  noise  increase  inside  the  mpport  constraint.  For  Eq.(18),  because  of  the  term  F(u)  and 
the  second  terms  in  the  brackets  in  Eq.(18),  noise  reduction  may  be  possible,  but  if  noise  reduction  is  achieved  not 
much  is  erqiected  since  the  noises  are  essentially  wide-sense  stationary.  Of  course,  near  the  edge  of  the  measured 
data  t^on,  the  variances  of  the  support-unstrained  Fourier  data  will  be  affected  quite  a  bit  because  of  the  zeros 
outside  the  measured  data  region,  so  superresolution  is  possible  because  of  this  as  for  the  high-light  level  case. 
OveraU,  less  noise  reduction  is  expected  for  the  low-light  level  case  than  for  the  high-light  level  case  since  the  real 
and  imaginary  variances  are  essentially  identical  away  from  dc,  but  large  amounts  of  noise  reduction  in  either  case 
are  not  expected.  The  same  functional  dependence  is  seen  in  the  variances  of  the  imaginaiy  part  of  the  siqrport- 
constrained  Fourier  data  as  well,  so  the  same  conclusions  apply. 

The  situation  where  CCD  read  noise  dominates  is  essentially  identical  to  the  case  where  shot  noise 
dominates,  so  not  much  noise  reduction  is  expected  in  this  limit,  as  well. 

One  final  issue  with  the  convex  projections  approach  is  that  the  ±2o  region  in  the  Fourier  domain  will,  in 
general,  not  be  the  true  ±2o  region  since  it  is  created  fiom  measured  data.  As  a  result,  errors  in  creating  this 
region  should  result  in  less  noise  reduction  than  what  would  occur  with  an  accurate  ±2o  region. 

Cost  Fttnction  MinimiatiQB 

The  second  algorithm  used  to  enforce  support  constraints  is  a  cost  function  minimization  approach.  The 
cost  function  minimized  is  given 


cost  function 
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dau  region 


where  the  a^(u)  and  o^(u)  terms  are  the  variances  of  the  real  and  imaginary  parts  of  the  measured  Fourier  data, 
reqtectively,  and  the  minimization  is  over  all  object  Fmirier  spectra  Og.  The  first  two  summations  are  the  data 

matching  terms,  while  the  third  is  the  regularization  term.  The  parameters  l/o^  and  \la\  act  as  regularization 

parameters  and  are  calculated  by  setting  a],  and  equal  to  the  average  variances  of  the  real  and  imaginaty  parts 
of  the  measured  Fourier  ^)ectrum,  reqtectively,  at  the  edge  of  the  data  matching  region.  The  cost  fiinction  is 
minimized  by  using  a  conjugate  gradient  minimization  ai^roach. 

The  cost  fiinction  minimization  approach  sluMdd  have  a  performance  similar  to  the  convex  projections 
^roach  with  one  major  exception.  Because  no  "hard  edges”  are  established  by  the  cost  fiinction  for  the  region  in 
tte  Fourier  domain  where  the  siqiport<constrained  Fourier  data  must  remain  as  the  minimization  proceeds,  the 
ctmelation  of  the  zeros  outside  of  the  measured  data  region  into  the  measured  data  region  can  significantly  modify 
the  measured  Fourier  <hita  This  results  in  much  worse  performance  for  the  cost  fiinction  approach  as  compared  to 
the  convex  projections  approach. 

4  Algorithm  Performance 

The  conqmter  simulation  runs  presented  in  this  section  were  accomplished  using  a  highly  accurate 
simulation  which  models  the  effects  of  atmosphere,  telescc^,  adaptive  (^cs,  photon  noise,  and  CO  read  noise^. 
Because  the  noise  effects  for  both  CCD  read  noise  and  photon  noise  are  structurally  similar,  CCD  read  noise  was 
not  included  in  the  simulations.  The  computer  simulation  was  used  to  obtain  both  images  and  pt^t  source 
corrections.  Sample  means  and  sample  variances  were  calculated  and  used  in  the  deconvolution  algorithms. 

Both  algorithms  were  run  for  a  variety  of  true  objects  using  the  two  telescope/AO  combinations  discussed 
in  Section  3.  For  each  true  object,  both  a  high  and  a  low  light  level  case  was  run.  For  each  conqiuter  simulation 
run,  a  filter  F(o)  was  chosen  as  follows: 


F(u) 


_^circ) 

H(u) 


(20) 


where  the  Fourier  transform  of  the  circle  function  was  chosen  in  order  that  a  finite  siq>port  could  be  ^lied  in  a 
way  consistent  with  the  ±2o  region  in  the  Fourier  domain.  The  size  of  the  circle  was  chosen  such  that  the  first 
zero  of  its  Fourier  transform  was  located  just  outside  the  region  of  accurately  measured  Fourier  data.  Thus  most  of 
the  energy  in  the  filter  was  located  in  the  region  in  FtHuier  space  where  measured  data  was  available.  This  was 
done  siitoe  it  has  been  shown^^  that  very  little  superresolution  is  achievable  for  data  with  moderate  SMRs  and  so 
most  of  the  emphasis  in  the  algorithm  was  placed  upon  improving  the  quality  of  the  measured  data  and  not 

siqierresolution.  The  true  object's  Fourier  q)ectrum  was  also  multiplied  by  ^(circ)  and  the  mean  square  error 
between  the  Muned  true  object  and  the  deconvolved  siuqwri-constrained  object  was  calculated  at  each  iteration  of 
the  algorithm.  This  abroach  follows  that  of  Lannes^*,  where  the  amount  of  achievable  siq)erresolution  is 
approximately  d^rmined  before  the  deconvolution  process  is  started,  and  the  measured  data  is  modified  by  a  filter 
to  be  consistent  with  this  amount  of  superresolution. 

A  number  of  interesting  results  were  seen  fiom  the  computer  simulation  runs.  The  first  is  that  the  cost 
function  minimization  algorithm  consistently  produced  deconvolved  images  which  had  noticeable  artifacts.  In 
general,  the  mean  square  error  in  the  image  increased  after  deconvolution  with  this  ^orithm,  but  in  one  case 
severe  aitifocts  were  seen  in  the  reconstruction  even  though  the  mean  square  errc  image  decreased.  The 
problem  appears  to  be  the  inability  of  the  algcnithm  to  enforce  hard  limits  on  the  i  Fourier  data  to  st^ 
within  the  ±2o  region  at  the  boundaries  of  the  measured  data.  Later  in  this  section  results  will  be  shown  which 
demonstrate  this  problem. 
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The  convex  projections  algorithm,  in  general,  resulted  in  decreased  noise  levels  in  the  image.  The  high 
light  level  scenario  r^ted  in  the  roost  noise  reduction,  as  expected,  and  noise  levels  never  increased  as  a  result  of 
suppmt  constraints.  The  average  mean  square  error  reduction  in  the  image  was  ai^roximately  10%.  In  the  low 
li^  level  scenario,  on  average,  no  reduction  in  noise  occurred.  Sometimes  tlw  noise  slightly  increased  and 
sronetimes  the  noise  slightly  decreased.  This  also  is  consistent  with  expectations  from  the  theory  in  Section  3. 

Two  difieient  forms  of  the  convex  projections  algorithm  were  used.  Tite  first  allowed  superresolution  to  occur, 
while  the  second  explicitly  zeroed  out  extrapolated  data  and  required  the  iterated  Fourier  data  n^u*  the  edge  of  the 
measured  data  regron  to  exactly  match  the  measured  data.  In  general,  the  algorithm  which  allowed  superresolution 
to  occur  resulted  in  noisier  image  recorrstructions.  This  also  was  expected  since  siqrerresolution  is  an  inherently 
noisy  imoess^^. 

Two  computer  simulation  results  will  now  be  discussed  in  detail.  The  first  nm  used  the  second 
telescope/ad^;)tive  optics  combination  which  is  a  realistic  model  of  the  AMOS  compensated  1 .6m  telescqre.  The 
tnieobjectwasa  Voyager  picture  of  Dione,  a  moon  of  Saturn.  A  high  light  level  case  was  run  with  10^^  photons 
per  frame.  This  resulted  in  Fourier  data  which  had  SNRs  of  well  over  10  for  all  spatial  frequencies  except  those  at 
the  extreme  edge  (tf^the  telescope  transfer  function.  The  measured  data  was  truncated  at  wtere  the  SNR 
approached  one.  One  hundred  iterations  of  both  the  convex  projection  algorithm  and  the  cost  function  algorithm 
were  run.  The  convex  projections  algorithm  was  run  twice.  The  second  time,  in  the  Fourier  domain  the  aipport- 
constrained  data  was  zeroed  out  outside  of  the  measured  region  on  each  iteration.  In  addition,  in  an  aimulus 
region  IS  pixels  wide  at  the  edge  of  the  measured  Fourier  data,  the  siq^rt-constrained  Fourier  data  was  replaced 
with  the  measured  data.  This  second  approach  to  convex  projections  was  accomplished  to  keq>  the  correlation  of 
the  zeros  outside  of  the  measured  data  from  propagating  inwards  and  comqrting  the  measured  data.  Thus  the 
image  domain  errors  for  this  case  reflect  onfy  the  changes  in  the  measured  Fourier  data  region  and  no 
superresdution  is  achieved  at  all. 

Figure  3  shows  the  error  in  the  Dione  reconstructions  as  a  function  of  iteration  number  for  both  convex 
prqjection  algorithms  and  the  cost  function  algorithm.  Notice  that  the  error  dramatically  increases  for  the  cost 
function  algorithm,  nliile  both  convex  projections  algorithms  result  in  reduced  noise,  llie  convex  projection 
algorithm  which  explicitly  prevents  any  superresolution  firom  occurring  has  lower  noise  levels  than  for  the  one 
which  allows  some  superresolution  to  occur.  This  is  not  surprising,  since  it  has 

been  shown  that  arQ^  superresolution  in  the  Fourier  data  is  much  noisier  than  the  measured  data^^.  The  true 
blurred  image,  the  linear  deconvolution  image  with  no  stqtpori  constraints,  and  the  images  resulting  from  the 
convex  prcgections  and  cost  function  algorithms  are  shown  in  Figure  4.  The  images  all  lodr  very  similar. 

Ahhou^  it  does  not  rqrroduce  well  on  ptqter,  the  cr»t  function  reconstruction  has  a  series  of  concentric  rings  near 
the  edge  of  Dione's  horizon  which  are  art^icts  not  .u.-^^ined  in  the  true  image.  Thus  the  increase  in  noise  shown 
in  Figure  3  is  not  just  a  generalized  noise  increase  m  ?  Tesult  of  specific  arti&cts.  To  analyze  this  efiect  further, 
slices  of  the  magnitude  of  the  reconstructed  Fourier  j^pcvtra  were  plotted  and  conqrared  to  the  true  Fourier 
q)ectrum.  The  results  ate  shown  in  Figure  S.  Notice  that  the  cost  function  reconstruction  is  much  noisier  than  the 
convex  projections  reconstruction  itear  the  edge  of  the  measured  data  region,  with  the  error  decreasing  as  qratial 
frequency  is  decreased.  This  is  consistent  with  the  e?q)lanation  given  in  Section  3,  that  the  cost  function  algorithm 
doesn't  prevent  the  zeros  outside  the  data  region  from  strongly  affecting  the  measured  Fourier  data  near  the  region 
boundary. 

The  convex  projection  reconstruction  doesn't  have  any  dramatic  improvement  in  image  quality. 
Apparently,  the  algorithm  resulted  in  lower  noise  levels  throughout  the  image,  but  even  the  achieved  mean  square 
error  reducfitni  of  35%  did  not  produce  dramatic  image  inqrrovements. 

The  low  light  level  computer  simulation  run  for  Dione  used  all  the  same  parameters  as  for  the  high  light 
level  case  except  that  10^  photons  per  frame  were  utilized.  The  error  in  the  image  reconstructions  as  a  function  of 
the  iteration  number  are  shown  in  Figure  6.  Notice  that  all  the  reconstructions  are  more  noi^  than  at  the  start,  but 
the  cost  function  algorithm  again  has  the  most  noise. 
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Figure  3.  Mean  square  enor  in  the  Dione  reconstructions  for  10^^  photons/frame.  The  solid  line  is  from  the  cost 
functitm  minimization  algorithm,  the  dashed  line  is  from  the  convex  projections  algorithm  with  superresolution, 
and  the  dotted  line  is  from  the  convex  projections  algorithm  with  no  siqxrresolutioa 
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Figure  4.  Dione  images:  blurred  true  image,  linear  deconvolution  reconstruction,  and  reconstructions  using  the 
cost  fimctitHi  and  convex  imyection  algorithms. 


DIone  Fourier  Domain  Slices 


Figure  5.  N<Hniialized  Dione  Fourier  domain  slices:  solid  line  is  from  the  true  blurred  Dione  q)ectnim,  dashed  line 
is  fiom  cost  function  reconstruction,  dotted  line  is  from  tlK  linear  reconstruction,  and  the  dot-dash  line  is  from  the 
convex  projections  reconstruction. 
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Figure  6.  hfean  square  error  in  the  Dione  recoi^tructions  for  10^  photons/firame.  The  sdid  line  is  from  tl^  cost 
fiinctkm  minimization  algorithm,  the  dashed  line  is  from  the  convex  projections  algorithm  with  siq)enesolution, 
and  the  dotted  line  is  from  the  convex  projections  algorithm  with  no  superresolution. 
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The  next  simulation  results  are  for  a  satellite  model.  The  first  combination  of  telescq)e/AO  was  used  for 
this  simulatioa  The  high  light  level  case  utilized  10^  photons  per  frame.  The  errors  in  the  recon^ructions  for  the 
cost  fiinction  algmithm  and  the  two  implementations  of  the  convex  projections  algorithms  are  show  in  Figure  7. 
Notice  that  there  is  essentially  no  noise  reduction  with  the  convex  projections  algorithms.  However,  notice  that  the 
cost  fiinction  algorithm  indicates  a  large  decrease  in  error  in  the  image.  This  indication  of  error  reducticm  is 
misleading,  as  can  be  seen  in  the  image  reconstruction  in  Figure  8.  Notice  that  cost  fimction  algorithm 
rtoonstruction  took  dim  parts  of  the  object  and  obliterated  them,  concentrating  the  energy  from  these  regions  into 
smaller,  higher  intensity  regions.  Two  important  conclusions  result  from  this  observation.  Ihe  fird  is  that  a  mean 
square  image  error  metric  is  only  useful  in  as  fiir  as  it  reflects  overall  noise  decrease  in  the  image.  It  does  not 
indicate  the  {uesenoe  of  artificts.  The  second  conclusion  is  about  the  concentration  of  energy  from  qiread  out  dim 
regions  of  the  image  into  smaller,  brighter  regions.  For  an  extended  object  such  as  a  satellite,  the  error  this  causes 
is  plain.  However,  it  is  precisely  this  type  of  behavior  that  is  used  to  cl^  superresolution  in  images  which  consist 
of  a  number  of  point  sources!  As  a  re^t,  mai^  claims  of  superresolution  in  the  literature  iiuq'  reflect  this  sort  of 
arti&ct  generation,  rather  than  true  siqierresolution. 

Fourier  domain  slices  of  the  true  blurred  image  and  the  reconstructions  are  shown  in  Figure  9.  The  point 
source  used  to  deconvolve  out  the  telescope/ AO  effects  was  modeled  as  slightly  inaccurate,  as  is  the  case  for  most 
field  data,  so  the  noise  is  not  zero  mean.  As  a  result,  interpr^g  the  error  in  the  cost  fimction  reconstruction  slice 
isn't  as  obvious  as  for  the  Dione  case.  However,  it  can  be  seen  that  the  cost  function  reconstruction  slice  of  the 
Fourier  data  is  significantly  different  from  the  true  object  slice  and  the  convex  projections  reconstruction  slices. 
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Figure  7.  Mean  square  error  in  the  satellite  reconstructions  for  10^  photons/frame.  The  solid  line  is  from  the  cost 
fiinction  minimization  algorithm,  the  dashed  line  is  from  the  convex  projections  algorithm  with  supenesolution, 
and  the  dotted  line  is  from  the  convex  projections  algorithm  with  no  supenesolutioa 
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Figures.  Satellite  images:  blurred  true  image,  linear  deconvolution  reconstruction,  and  reconstructions  using  the 
cost  fiinctitm  and  convex  projection  algorithms. 


Figure  9.  Normalized  satellite  Fourier  domain  slices:  solid  line  is  from  the  true  blurred  satellite  q)ectrum,  dashed 
line  is  fiom  cost  function  reconstruction,  dotted  line  is  firom  the  linear  reconstruction,  and  the  dot-dash  line  is  from 
the  convex  imgections  reccmstruction. 


The  low  light  level  simulation  nm  for  this  satellite  model  is  the  same  as  for  the  high  light  level  case 
excqn  that  10^  photons  per  frame  were  utilized.  The  errors  in  the  reconstructions  are  shown  in  Figure  10,  and  it 
can  be  seen  that  the  convex  projections  algorithms  again  did  not  result  in  noise  reduction,  while  the  cost  function 
algorithm  indicates  a  small  anmunt  of  decrease.  The  cost  function  algorithm  terminated  after  60+  iterations 
because  the  cost  function  had  stqiped  decreasing. 

Finally,  the  two  algorithim  were  run  using  field  data  collected  fiom  the  AMOS  1 .6m  telescope.  The  first 
image  reduced  was  Ganymede.  The  reconstructions  were  in  the  low  light  level  case  since  the  SNR  of  the  data 
i^roached  one  at  ^roximately  20%  of  the  difEraction  limit.  Thus  large  amounts  of  image  improvement  are  not 
expected.  The  reconstructions  are  shown  in  Figure  1 1,  where  an  additional  convex  projections  algorithm  was  run 
using  positivity  as  well  as  sunlit  as  a  constraint.  The  linear  deconvolution  result  shows  the  presence  of  what  is 
prohal^  the  region  Galileo  ^gio  in  the  right<entral  part  of  the  image.  The  size  of  this  feature  is  consistent  with 
images  obtained  from  the  Voyager  probes.  The  cost  fimction  reconstruction  shows  the  same  sort  of  artifacts  as 
seen  in  the  satellite  reconstructions  of  Figure  8.  The  dim  regions  of  the  moon  have  energy  taken  away  from  them 
and  added  to  the  bright  part  of  the  moon.  This  results  in  the  reconstruction  of  the  region  Galileo  Regio  increasing 
in  size,  and  the  overall  moon  diameter  decreasing. 

The  convex  projections  reconstruction  shows  small  differences  between  it  and  the  linear  reconstruction 
image.  From  the  conqntter  simulations,  this  may  or  may  not  be  more  accurate  than  the  linear  reconstruction  since, 
in  the  low  light  level  cases,  noise  levels  both  increased  slightly  and  decreased  slightly.  In  addition,  a  convex 
projections  reconstruction  was  accomplished  using  both  suj^rt  and  positivity.  The  differences  between  the 
reconstructions  with  positivity  and  without  positivity  are  i^gligible. 
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Figure  10.  Mean  square  error  in  the  satellite  reconstructions  for  10^  photons/fiame.  The  solid  line  is  from  the  cost 
function  minimization  algorithm,  the  dashed  line  is  fiom  the  convex  projections  algorithm  with  superresolution, 
and  the  dotted  line  is  fiom  the  convex  projections  algorithm  with  no  superresolution. 


Linear  Oaconvolution 


CF  -  Support 


CP  -  Support  CP  —  Support,  Positivity 

Figure  11.  Image  leconstiuctioiis  of  Ganymede:  Linear  deconvolution  reconstruction,  cost  fimction 
reconstruction,  and  convex  projections  reconstructions  with  and  without  positivity. 


Linear  Deconvolution 


CP  —  Support 


CF  -  Support 


CP  —  Support.  Positivity 


Figure  12.  Image  reconstructions  of  the  Hubble  qace  telescqre:  Linear  deconvolution  reconstruction,  cost 
function  reconstruction,  and  convex  projections  reconstructions  with  and  without  positivity. 
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The  second  field  data  image  to  be  reduced  is  an  image  of  the  Hubble  space  telescope.  The  reconstructions 
are  shown  in  Figure  12.  As  for  Ganymede,  both  convex  projections  algorithms  are  very  similar  to  the  linear 
deconvolution  image.  The  cost  function  reconstrriction  again  shows  energy  being  taken  from  the  dim  regions  and 
moved  towards  the  brighter  regions.  This  is  e^recially  apparent  on  the 

solar  panels.  In  addition,  the  brightly  reflecting  region  on  the  upper  solar  panel  where  the  support  attaches  the 
solar  panel  to  the  main  body  is  diffused  out  in  the  cost  function  reconstruction.  Since  the  size  of  the  attachment  is 
known  to  be  smaller  than  the  cost  function  reconstruction  indicates,  this  shows  nmre  arti&ct  generation. 

?.  CoKlusioas 

Siq^rt  constraints  resulted  in  approximately  10%  decreases  in  mean  square  error,  on  avera^,  in  the 
image  domain  for  imagery  collected  on  ad^ve  qrtically  corrected  telescopes  for  the  two  combinations  considered 
here  in  the  high  light  level  situation  for  resolved  images.  For  low  light  levels,  on  average  no  mean  square  error 
decreases  were  obtained.  Since  most  astronomical  and  space  objects  will  result  in  low  light  levels,  this  indicates 
that  support  constraints  will  provide  only  marginal  improvement  at  best  in  adaptive  optics  data.  A  convex 
projections  algorithm  should  be  used  to  implement  the  siqrport  constraints  if  such  constraints  are  airbed  since  tlM 
cost  funcbon  approach  is  more  susceptible  to  artifact  generabon.  This  could  be  combated  by  excessively  weighting 
the  cost  function  for  data  points  neat  the  edge  of  the  measured  data  region.  However,  the  convex  projecbons 
algorithm  is  quick  and  apparendy  not  error-qrone,  so  it  a{q)ears  to  be  the  algorithm  of  choice  for  enforcing  stq^rt 
constraints. 
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